2021-01-27T16:07:51.480 INFO:root:teuthology version: 1.0.0-83ba941a 2021-01-27T16:07:51.482 DEBUG:teuthology.run:Teuthology command: teuthology --name sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi --block --archive /home/teuthworker/archive/sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi/5833653 --description rados:cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} --owner scheduled_sage@teuthology --lock --verbose -- /tmp/teuthology-worker.if8dbi5_.tmp 2021-01-27T16:07:51.507 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T16:07:51.563 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi/5833653 branch: wip-sage-testing-2021-01-26-2148 description: rados:cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} email: null first_in_suite: false job_id: '5833653' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-01-26-2148 ceph: conf: global: mon election default strategy: 3 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: cephadm-package install: ceph: sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 extra_packages: - cephadm workunit: branch: wip-sage-testing-2021-01-26-2148 sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 sleep_before_teardown: 0 suite: rados:cephadm suite_branch: wip-sage-testing-2021-01-26-2148 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2021-01-26-2148/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test_python.sh teuthology_branch: master timestamp: 2021-01-27_14:59:02 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.1445 2021-01-27T16:07:51.564 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2021-01-26-2148/qa; will attempt to use it 2021-01-27T16:07:51.564 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2021-01-26-2148/qa/tasks 2021-01-27T16:07:51.565 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-27T16:07:51.567 INFO:teuthology.task.internal:Checking packages... 2021-01-27T16:07:51.586 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '9f8421bb8d39043f85c071a52714801b60d36be5' 2021-01-27T16:07:51.586 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-27T16:07:51.587 INFO:teuthology.packaging:ref: None 2021-01-27T16:07:51.587 INFO:teuthology.packaging:tag: None 2021-01-27T16:07:51.587 INFO:teuthology.packaging:branch: wip-sage-testing-2021-01-26-2148 2021-01-27T16:07:51.588 INFO:teuthology.packaging:sha1: 9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:07:51.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-01-26-2148 2021-01-27T16:07:51.747 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-142-g9f8421bb-1focal 2021-01-27T16:07:51.748 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-27T16:07:51.758 INFO:teuthology.task.internal:no buildpackages task found 2021-01-27T16:07:51.758 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-27T16:07:51.783 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-27T16:07:51.784 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T16:07:51.830 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:01.845 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:11.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:21.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:31.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:41.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:08:51.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:01.936 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:11.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:21.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:31.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:42.001 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:09:52.019 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:02.037 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:12.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:22.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:32.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:42.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:10:52.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:02.133 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:12.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:22.166 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:32.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:42.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:11:52.211 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:02.226 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:12.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:22.259 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:32.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:42.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:12:52.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:02.319 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:12.334 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:22.365 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:32.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:42.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:13:52.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:02.426 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:12.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:22.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:32.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:42.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:14:52.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:02.527 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:12.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:22.557 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:32.573 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:42.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:15:52.606 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:02.623 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:12.635 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:22.651 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:32.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:42.676 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:16:52.694 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:17:02.710 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:17:12.732 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-27T16:17:22.748 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:17:32.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:17:42.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:17:52.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:18:02.817 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-27T16:18:12.834 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_sage@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi/5833653'} 2021-01-27T16:18:12.857 DEBUG:teuthology.lock.ops:locked ubuntu@smithi106.front.sepia.ceph.com, ubuntu@smithi094.front.sepia.ceph.com 2021-01-27T16:18:12.910 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6df25f49d8>, signals=[15]) 2021-01-27T16:18:13.120 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of ubuntu 20.04 2021-01-27T16:18:13.123 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of ubuntu 20.04 2021-01-27T16:18:13.469 INFO:teuthology.orchestra.console:Power off smithi094 2021-01-27T16:18:13.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T16:18:13.492 INFO:teuthology.orchestra.console:Power off smithi106 2021-01-27T16:18:13.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-27T16:18:13.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:13.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:17.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:17.537 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:21.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:21.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:21.849 INFO:teuthology.orchestra.console:Power off for smithi094 completed 2021-01-27T16:18:21.858 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2021-01-27T16:18:21.951 INFO:teuthology.orchestra.console:Power on smithi094 2021-01-27T16:18:21.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T16:18:21.961 INFO:teuthology.orchestra.console:Power on smithi106 2021-01-27T16:18:21.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-27T16:18:21.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:21.983 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:25.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:26.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:30.114 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:30.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-27T16:18:30.332 INFO:teuthology.orchestra.console:Power on for smithi094 completed 2021-01-27T16:18:30.339 INFO:teuthology.orchestra.console:Power on for smithi106 completed 2021-01-27T16:18:30.434 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2021-01-27T16:18:30.439 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2021-01-27T16:21:31.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:31.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:40.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:40.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:49.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:49.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:58.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:21:58.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:07.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:07.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:16.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:16.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:26.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:26.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:22:35.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:12.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:18.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:24.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:30.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:32.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:32.209 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T16:23:32.211 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T16:23:32.681 INFO:teuthology.provision.fog.smithi094:Node is ready 2021-01-27T16:23:32.682 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2021-01-27T16:23:32.729 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2021-01-27T16:23:32.730 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2021-01-27T16:23:32.737 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2021-01-27T16:23:32.738 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2021-01-27T16:23:32.858 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2021-01-27T16:23:32.875 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2021-01-27T16:23:32.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2021-01-27T16:23:32.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2021-01-27T16:23:32.954 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2021-01-27T16:23:32.955 DEBUG:teuthology.parallel:result is None 2021-01-27T16:23:36.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:36.598 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-27T16:23:36.598 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-27T16:23:37.164 INFO:teuthology.provision.fog.smithi106:Node is ready 2021-01-27T16:23:37.164 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2021-01-27T16:23:37.171 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2021-01-27T16:23:37.171 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2021-01-27T16:23:37.222 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2021-01-27T16:23:37.223 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2021-01-27T16:23:37.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2021-01-27T16:23:37.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2021-01-27T16:23:37.400 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2021-01-27T16:23:37.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2021-01-27T16:23:37.429 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2021-01-27T16:23:37.430 DEBUG:teuthology.parallel:result is None 2021-01-27T16:23:37.592 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2021-01-27T16:23:37.593 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T16:23:37.610 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2021-01-27T16:23:37.611 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-27T16:23:37.627 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2021-01-27T16:23:37.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:23:37.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:37.683 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-01-27T16:23:37.799 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2021-01-27T16:23:37.806 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2021-01-27T16:23:37.806 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2021-01-27T16:23:37.811 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2021-01-27T16:23:37.811 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T16:23:37.811 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2021-01-27T16:23:37.811 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2021-01-27T16:23:37.812 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T16:23:37.812 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="20.04" 2021-01-27T16:23:37.812 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T16:23:37.812 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T16:23:37.812 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T16:23:37.813 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T16:23:37.813 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=focal 2021-01-27T16:23:37.813 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=focal 2021-01-27T16:23:37.814 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2021-01-27T16:23:37.831 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2021-01-27T16:23:37.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:23:37.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:37.869 DEBUG:teuthology.orchestra.run.smithi094:> true 2021-01-27T16:23:37.976 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2021-01-27T16:23:37.982 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2021-01-27T16:23:37.982 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2021-01-27T16:23:37.988 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2021-01-27T16:23:37.988 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T16:23:37.988 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2021-01-27T16:23:37.988 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2021-01-27T16:23:37.989 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T16:23:37.989 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="20.04" 2021-01-27T16:23:37.989 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T16:23:37.989 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T16:23:37.989 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T16:23:37.990 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T16:23:37.990 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=focal 2021-01-27T16:23:37.990 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=focal 2021-01-27T16:23:37.991 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-01-27T16:23:38.006 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2021-01-27T16:23:38.039 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi094.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCje/UdGswI178+3zPV9ylIPt0byOJqKvyDayiLf8VxpUZ/ikJ+l7lYAdvrevbZKEsaY1Kg16BPCUxSh1Zuezz2uc1F7eIt0I9DWTVMuustdPgayd4WB3lUD7YNhw6KNocaf+b6Ov4nkt4HoJZkt07bP0YE6fun0JZRDRLw91nHVruH4crLssNISjJz+ZheaHXdax8wQvDmFx0edjbc8THq8btoHGoEJknNn8oQk3X7WzW7GkAx4DrB2HjNQWIiez8BFZPBp8aQuOBiQGS5UluQo6u5m/f6mUjQ1SHRVT3f0zn239jp0pE3eW5mqp23H5Qms9nIjPm525PGsQZrHD7pcOwXFJC9TKpD3NbI01lamHUNMPOkX2QL639Dee1j6v1Yyi6FJBnXYvXaKHx1cOJfmEiQvHmQGMXkk+Fc+2Bdw6p4H56GYuWDn2DR3Try7hxA7+s32c8VG0J8ONnsqG3DP2V7MfJL1Mf6l4ZXLNvf4O8q1A1Sf7tqIb97OWIkYsU= smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbN8nSZYs9D5sjM1xpjuiXQn3/JUW+ZT9VnafchDGwTVTmlFiGXc/FckHfW3/ceORH9S8L+60nhT7fM9V9hjkshiTw2IE+t8pW1kp/y5pOfJWg6BEhtpOvhW4cxiHhIRzeIUt5vehcc5oiU32VsrmsQL8ZoVkheoh9wit+U2KbFZo+zgaL6sF372Bte0ioDN7nswwSHpegJ14SIMLrd5iljRPTWQ75wyyAIbGlOH9h5E81yMubVMV7OJwDZToogJKNdKEy8y8OMPQuLtC17EfY5rNIX0yx4qhP5APg4SfTxBjfeyEUWxGZbR0xBlpXksOpYQiH9yGJM+IX6iLF62lnk0Vu7VteZ1jN9pHO+Hv2tfCi7sUHLp06TgFhT8UWFAsRJlniF6Kk9xXqPiQMvebO8W0CELm2NBTn6hYPuPH9dHt6agPU4pEVTalX0hZFdpoB6MoGM08kqyClUKpARJYQUUUYUPVow4fanAs8Lu0DFYnW1X7bEiuvRZ6zoj5skOM= 2021-01-27T16:23:38.040 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-27T16:23:38.092 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-27T16:23:38.104 INFO:teuthology.task.internal:Saving configuration 2021-01-27T16:23:38.127 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-27T16:23:38.175 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-27T16:23:38.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 16:18:12.842823', 'description': '/home/teuthworker/archive/sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi/5833653', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINZeSL3GCXef6OoCUggkmVi7aklpiew8UoOPz40nYMCP', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi106.front.sepia.ceph.com'} 2021-01-27T16:23:38.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-27 16:18:12.842842', 'description': '/home/teuthworker/archive/sage-2021-01-27_14:59:02-rados:cephadm-wip-sage-testing-2021-01-26-2148-distro-basic-smithi/5833653', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJB2ZmNnpWtqOOHnK3YmGj5PD3ElY6tscmVzFTIfSd8p', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi094.front.sepia.ceph.com'} 2021-01-27T16:23:38.212 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-27T16:23:38.223 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-01-27T16:23:38.223 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-01-27T16:23:38.224 INFO:teuthology.run_tasks:Running task console_log... 2021-01-27T16:23:38.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6df604af28>, signals=[15]) 2021-01-27T16:23:38.307 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-27T16:23:38.333 INFO:teuthology.task.internal:Opening connections... 2021-01-27T16:23:38.333 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2021-01-27T16:23:38.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:38.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2021-01-27T16:23:38.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:23:38.432 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-27T16:23:38.443 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2021-01-27T16:23:38.512 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2021-01-27T16:23:38.513 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2021-01-27T16:23:38.518 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2021-01-27T16:23:38.518 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T16:23:38.518 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2021-01-27T16:23:38.519 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2021-01-27T16:23:38.519 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T16:23:38.519 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="20.04" 2021-01-27T16:23:38.519 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T16:23:38.519 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T16:23:38.520 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T16:23:38.520 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T16:23:38.520 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=focal 2021-01-27T16:23:38.520 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=focal 2021-01-27T16:23:38.521 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2021-01-27T16:23:38.536 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2021-01-27T16:23:38.541 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2021-01-27T16:23:38.541 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2021-01-27T16:23:38.589 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2021-01-27T16:23:38.589 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-27T16:23:38.589 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2021-01-27T16:23:38.590 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2021-01-27T16:23:38.590 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-27T16:23:38.590 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="20.04" 2021-01-27T16:23:38.590 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-27T16:23:38.591 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-27T16:23:38.591 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-27T16:23:38.591 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-27T16:23:38.591 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=focal 2021-01-27T16:23:38.591 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=focal 2021-01-27T16:23:38.592 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2021-01-27T16:23:38.606 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-27T16:23:38.712 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-27T16:23:38.721 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-27T16:23:38.721 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2021-01-27T16:23:38.724 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2021-01-27T16:23:38.730 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-27T16:23:38.766 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-27T16:23:38.767 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2021-01-27T16:23:38.769 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2021-01-27T16:23:38.823 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-27T16:23:38.872 INFO:teuthology.run_tasks:Running task kernel... 2021-01-27T16:23:38.893 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-01-27T16:23:38.894 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-27T16:23:38.894 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2021-01-27T16:23:38.901 INFO:teuthology.orchestra.run.smithi106.stdout:5.4.0-64-generic 2021-01-27T16:23:38.901 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.4.0-64-generic 2021-01-27T16:23:38.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2021-01-27T16:23:39.112 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2021-01-27T16:23:39.408 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:23:39.410 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T16:23:39.468 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T16:23:39.796 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T16:23:39.876 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-27T16:23:40.003 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T16:23:40.154 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-27T16:23:40.169 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-27T16:23:40.179 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-27T16:23:40.180 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T16:23:40.190 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T16:23:40.190 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-27T16:23:40.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-27T16:23:40.261 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [531 kB] 2021-01-27T16:23:40.284 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-27T16:23:40.303 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T16:23:40.304 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-27T16:23:40.304 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.4 kB] 2021-01-27T16:23:40.310 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,712 B] 2021-01-27T16:23:40.315 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-27T16:23:40.317 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T16:23:40.361 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T16:23:40.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T16:23:40.391 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T16:23:40.392 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T16:23:40.392 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T16:23:40.442 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T16:23:44.113 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 5,291 kB in 1s (3,565 kB/s) 2021-01-27T16:23:45.152 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:23:45.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T16:23:45.233 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:23:45.368 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-01-27T16:23:45.368 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-01-27T16:23:45.435 INFO:teuthology.orchestra.run.smithi106.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T16:23:45.437 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T16:23:45.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T16:23:45.504 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:23:45.656 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-01-27T16:23:45.657 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-01-27T16:23:45.787 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2021-01-27T16:23:45.787 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T16:23:45.788 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T16:23:45.788 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T16:23:45.788 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2021-01-27T16:23:45.788 INFO:teuthology.orchestra.run.smithi106.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T16:23:45.789 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2021-01-27T16:23:45.789 INFO:teuthology.orchestra.run.smithi106.stdout: thermald 2021-01-27T16:23:45.812 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2021-01-27T16:23:45.813 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T16:23:45.813 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T16:23:45.813 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T16:23:45.814 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2021-01-27T16:23:45.814 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T16:23:45.989 INFO:teuthology.orchestra.run.smithi106.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-27T16:23:45.989 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 74.1 MB of archives. 2021-01-27T16:23:45.990 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T16:23:45.990 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T16:23:47.012 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T16:23:47.259 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T16:23:48.458 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T16:23:48.458 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T16:23:48.459 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T16:23:48.728 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T16:23:48.740 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T16:23:49.203 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 74.1 MB in 3s (25.4 MB/s) 2021-01-27T16:23:49.422 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T16:23:51.388 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T16:23:51.392 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:23:51.508 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:23:53.350 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T16:23:53.363 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:23:53.458 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:23:54.453 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T16:23:54.468 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:23:54.511 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:23:59.080 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:23:59.222 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:23:59.573 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:23:59.676 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:24:00.046 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T16:24:00.061 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T16:24:00.104 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T16:24:06.306 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T16:24:06.329 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:24:06.372 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:09.133 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:24:09.258 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:24:09.615 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T16:24:09.738 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:10.882 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:11.008 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T16:24:11.134 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:12.220 INFO:teuthology.orchestra.run.smithi106.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T16:24:12.220 INFO:teuthology.orchestra.run.smithi106.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T16:24:12.361 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:13.571 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T16:24:13.697 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T16:24:13.816 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:14.005 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T16:24:14.005 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:24:36.070 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T16:24:36.070 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2021-01-27T16:24:36.076 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T16:24:36.103 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2021-01-27T16:24:36.429 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T16:24:36.500 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:24:36.896 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T16:24:36.907 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T16:24:39.002 INFO:teuthology.orchestra.run.smithi106.stdout:done 2021-01-27T16:24:39.355 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2021-01-27T16:24:39.381 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2021-01-27T16:24:39.382 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2021-01-27T16:24:39.382 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2021-01-27T16:24:39.382 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2021-01-27T16:24:39.383 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 18 2021-01-27T16:24:39.383 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T16:24:39.383 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2021-01-27T16:24:39.383 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2021-01-27T16:24:39.383 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.4.0.65.68 2021-01-27T16:24:39.384 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T16:24:39.384 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T16:24:39.384 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2021-01-27T16:24:39.384 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2021-01-27T16:24:39.385 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2021-01-27T16:24:39.385 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2021-01-27T16:24:39.385 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T16:24:39.386 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2021-01-27T16:24:39.393 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-64-generic 2021-01-27T16:24:39.393 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.4.0-64-generic 2021-01-27T16:24:39.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2021-01-27T16:24:39.592 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2021-01-27T16:24:39.786 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-27T16:24:39.881 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:24:39.959 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-27T16:24:40.091 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-27T16:24:40.164 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-27T16:24:40.194 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-27T16:24:40.200 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-27T16:24:40.200 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-27T16:24:40.214 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-27T16:24:40.214 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [531 kB] 2021-01-27T16:24:40.219 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-27T16:24:40.226 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.4 kB] 2021-01-27T16:24:40.228 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,712 B] 2021-01-27T16:24:40.288 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-27T16:24:40.414 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-27T16:24:40.611 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-27T16:24:40.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-27T16:24:40.729 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-27T16:24:40.730 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-27T16:24:40.742 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-27T16:24:40.743 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-27T16:24:40.776 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-27T16:24:40.813 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-27T16:24:40.819 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-27T16:24:40.820 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-27T16:24:40.821 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-27T16:24:40.867 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-27T16:24:43.485 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 5,291 kB in 1s (4,001 kB/s) 2021-01-27T16:24:44.515 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:24:44.537 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T16:24:44.607 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:24:44.755 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2021-01-27T16:24:44.755 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2021-01-27T16:24:44.822 INFO:teuthology.orchestra.run.smithi094.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T16:24:44.823 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T16:24:44.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T16:24:44.888 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:24:45.038 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2021-01-27T16:24:45.039 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2021-01-27T16:24:45.161 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2021-01-27T16:24:45.161 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T16:24:45.162 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-27T16:24:45.162 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-27T16:24:45.162 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2021-01-27T16:24:45.163 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-27T16:24:45.163 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2021-01-27T16:24:45.163 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2021-01-27T16:24:45.192 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2021-01-27T16:24:45.192 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-27T16:24:45.192 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-27T16:24:45.193 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-27T16:24:45.193 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2021-01-27T16:24:45.193 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-27T16:24:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-27T16:24:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 74.1 MB of archives. 2021-01-27T16:24:45.367 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-27T16:24:45.368 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-27T16:24:46.720 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-27T16:24:46.972 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-27T16:24:48.192 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-27T16:24:48.193 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-27T16:24:48.193 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-27T16:24:48.469 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-27T16:24:48.523 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-27T16:24:48.995 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 74.1 MB in 3s (22.3 MB/s) 2021-01-27T16:24:49.148 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-27T16:24:51.140 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-27T16:24:51.145 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:24:51.217 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:53.100 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-27T16:24:53.117 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:24:53.211 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:54.170 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-27T16:24:54.183 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:24:54.227 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:24:58.873 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:24:58.988 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:24:59.291 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:24:59.416 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:24:59.753 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-27T16:24:59.768 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-27T16:24:59.811 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T16:25:05.260 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-27T16:25:05.284 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-27T16:25:05.326 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:07.888 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-27T16:25:08.017 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-27T16:25:08.363 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-27T16:25:08.488 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:09.776 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:09.902 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-27T16:25:10.003 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:11.069 INFO:teuthology.orchestra.run.smithi094.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-27T16:25:11.069 INFO:teuthology.orchestra.run.smithi094.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-27T16:25:11.206 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:12.299 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-27T16:25:12.417 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-27T16:25:12.519 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-27T16:25:12.704 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-27T16:25:12.704 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-27T16:25:34.127 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2021-01-27T16:25:34.153 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T16:25:34.182 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2021-01-27T16:25:34.520 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T16:25:34.547 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:25:34.935 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T16:25:34.946 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T16:25:36.912 INFO:teuthology.orchestra.run.smithi094.stdout:done 2021-01-27T16:25:37.276 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2021-01-27T16:25:37.326 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2021-01-27T16:25:37.326 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2021-01-27T16:25:37.326 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2021-01-27T16:25:37.327 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2021-01-27T16:25:37.327 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 18 2021-01-27T16:25:37.327 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T16:25:37.327 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2021-01-27T16:25:37.327 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2021-01-27T16:25:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.65.68 2021-01-27T16:25:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T16:25:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T16:25:37.328 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2021-01-27T16:25:37.329 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2021-01-27T16:25:37.329 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2021-01-27T16:25:37.329 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2021-01-27T16:25:37.329 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-27T16:25:37.330 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-01-27T16:25:37.330 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T16:25:37.330 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-27T16:25:37.331 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-01-27T16:25:37.331 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T16:25:37.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2021-01-27T16:25:37.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2021-01-27T16:25:37.714 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T16:25:37.720 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:25:37.799 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T16:25:37.878 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T16:25:39.126 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:25:39.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T16:25:39.211 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:25:39.364 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-01-27T16:25:39.365 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-01-27T16:25:39.442 INFO:teuthology.orchestra.run.smithi106.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T16:25:39.443 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T16:25:39.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T16:25:39.512 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:25:39.662 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-01-27T16:25:39.663 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-01-27T16:25:39.799 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T16:25:39.799 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-27T16:25:39.801 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2021-01-27T16:25:39.826 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2021-01-27T16:25:39.826 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2021-01-27T16:25:39.826 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2021-01-27T16:25:39.826 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2021-01-27T16:25:39.827 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 18 2021-01-27T16:25:39.827 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T16:25:39.827 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2021-01-27T16:25:39.827 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2021-01-27T16:25:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.4.0.65.68 2021-01-27T16:25:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T16:25:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T16:25:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2021-01-27T16:25:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2021-01-27T16:25:39.829 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2021-01-27T16:25:39.829 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2021-01-27T16:25:39.829 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2021-01-27T16:25:39.836 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.sIOfak1eAK 2021-01-27T16:25:39.836 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.sIOfak1eAK 2021-01-27T16:25:39.901 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.sIOfak1eAK 2021-01-27T16:25:39.947 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.sIOfak1eAK is 8KB 2021-01-27T16:25:39.961 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.sIOfak1eAK 2021-01-27T16:25:39.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T16:25:40.021 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:25:40.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T16:25:40.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T16:25:40.074 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T16:25:40.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2021-01-27T16:25:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2021-01-27T16:25:41.165 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T16:25:41.185 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2021-01-27T16:25:41.455 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T16:25:41.467 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:25:41.836 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T16:25:41.848 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T16:25:42.889 INFO:teuthology.orchestra.run.smithi106.stderr:done 2021-01-27T16:25:42.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2021-01-27T16:25:42.893 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-01-27T16:25:42.893 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2021-01-27T16:25:42.894 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2021-01-27T16:25:42.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2021-01-27T16:25:43.221 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:25:43.222 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T16:25:43.289 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T16:25:43.369 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T16:25:44.633 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:25:44.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-27T16:25:44.722 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:25:44.874 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2021-01-27T16:25:44.875 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2021-01-27T16:25:44.952 INFO:teuthology.orchestra.run.smithi094.stderr:E: Unable to locate package linux-image-current-generic 2021-01-27T16:25:44.954 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-27T16:25:44.954 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-27T16:25:45.024 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:25:45.175 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2021-01-27T16:25:45.176 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2021-01-27T16:25:45.323 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-27T16:25:45.323 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-27T16:25:45.325 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2021-01-27T16:25:45.347 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2021-01-27T16:25:45.348 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2021-01-27T16:25:45.348 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2021-01-27T16:25:45.348 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2021-01-27T16:25:45.349 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 18 2021-01-27T16:25:45.349 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2021-01-27T16:25:45.349 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2021-01-27T16:25:45.349 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2021-01-27T16:25:45.349 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.65.68 2021-01-27T16:25:45.350 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-27T16:25:45.350 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-27T16:25:45.350 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2021-01-27T16:25:45.350 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2021-01-27T16:25:45.350 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2021-01-27T16:25:45.351 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2021-01-27T16:25:45.351 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2021-01-27T16:25:45.395 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.x5W866v6zL 2021-01-27T16:25:45.395 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.x5W866v6zL 2021-01-27T16:25:45.411 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.x5W866v6zL 2021-01-27T16:25:45.502 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.x5W866v6zL is 8KB 2021-01-27T16:25:45.517 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.x5W866v6zL 2021-01-27T16:25:45.524 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-27T16:25:45.584 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:25:45.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-27T16:25:45.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-27T16:25:45.621 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-27T16:25:45.621 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2021-01-27T16:25:46.891 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2021-01-27T16:25:46.893 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-27T16:25:46.905 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2021-01-27T16:25:47.147 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-27T16:25:47.159 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-27T16:25:47.503 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-27T16:25:47.515 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-27T16:25:48.505 INFO:teuthology.orchestra.run.smithi094.stderr:done 2021-01-27T16:25:48.507 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2021-01-27T16:26:18.524 INFO:teuthology.misc:Re-opening connections... 2021-01-27T16:26:18.525 INFO:teuthology.misc:trying to connect to ubuntu@smithi106.front.sepia.ceph.com 2021-01-27T16:26:18.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:26:18.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:26:36.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2021-01-27T16:26:36.868 INFO:teuthology.misc:trying to connect to ubuntu@smithi094.front.sepia.ceph.com 2021-01-27T16:26:36.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:26:36.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:27:36.871 DEBUG:teuthology.orchestra.remote:timed out 2021-01-27T16:27:36.881 DEBUG:teuthology.misc:waited 78.35569047927856 2021-01-27T16:27:37.881 INFO:teuthology.misc:trying to connect to ubuntu@smithi106.front.sepia.ceph.com 2021-01-27T16:27:37.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:27:37.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:27:38.013 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-01-27T16:27:38.464 DEBUG:teuthology.misc:waited 79.9396243095398 2021-01-27T16:27:39.465 INFO:teuthology.misc:trying to connect to ubuntu@smithi094.front.sepia.ceph.com 2021-01-27T16:27:39.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:27:39.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:27:39.610 DEBUG:teuthology.orchestra.run.smithi094:> true 2021-01-27T16:27:40.059 DEBUG:teuthology.misc:waited 81.53437495231628 2021-01-27T16:27:41.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-01-27T16:27:41.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-65-generic"... 2021-01-27T16:27:41.061 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2021-01-27T16:27:41.068 INFO:teuthology.orchestra.run.smithi106.stdout:5.4.0-65-generic 2021-01-27T16:27:41.068 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T16:27:41.069 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T16:27:41.069 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T16:27:41.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-01-27T16:27:41.070 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-65-generic"... 2021-01-27T16:27:41.070 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2021-01-27T16:27:41.075 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-65-generic 2021-01-27T16:27:41.075 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-27T16:27:41.076 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-27T16:27:41.076 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-27T16:27:42.077 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-27T16:27:42.077 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T16:27:42.156 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2021-01-27T16:27:42.190 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-27T16:27:42.190 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-27T16:27:42.279 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2021-01-27T16:27:42.317 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-27T16:27:42.328 INFO:teuthology.task.internal:Creating test directory... 2021-01-27T16:27:42.328 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T16:27:42.331 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-27T16:27:42.338 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-27T16:27:42.397 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-27T16:27:42.438 INFO:teuthology.task.internal:Creating archive directory... 2021-01-27T16:27:42.438 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T16:27:42.441 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-27T16:27:42.454 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-27T16:27:42.480 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-27T16:27:42.480 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T16:27:42.483 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-27T16:27:42.510 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T16:27:42.516 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T16:27:42.520 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T16:27:42.526 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-27T16:27:42.528 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-27T16:27:42.542 INFO:teuthology.task.internal:Configuring sudo... 2021-01-27T16:27:42.542 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T16:27:42.565 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-27T16:27:42.582 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-27T16:27:42.595 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-27T16:27:42.595 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T16:27:42.598 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-27T16:27:42.604 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T16:27:42.654 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T16:27:42.661 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:27:42.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T16:27:42.688 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-27T16:27:42.696 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-27T16:27:42.703 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:27:42.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-27T16:27:42.722 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2021-01-27T16:27:42.765 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2021-01-27T16:27:42.807 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-27T16:27:42.818 INFO:teuthology.task.internal:Starting timer... 2021-01-27T16:27:42.818 INFO:teuthology.run_tasks:Running task pcp... 2021-01-27T16:27:42.839 INFO:teuthology.run_tasks:Running task selinux... 2021-01-27T16:27:42.853 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2021-01-27T16:27:42.854 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2021-01-27T16:27:42.854 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-27T16:27:42.854 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-27T16:27:42.855 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-27T16:27:42.855 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-27T16:27:42.870 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-01-27T16:27:42.881 INFO:teuthology.repo_utils:Fetching master from origin 2021-01-27T16:27:43.015 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-01-27T16:27:43.147 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-27T16:27:43.151 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi094.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-27T16:27:43.899 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-27T16:27:45.952 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-27T16:27:48.629 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-27T16:27:48.670 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:48 +0000 (0:00:00.095) 0:00:00.095 ***** 2021-01-27T16:27:48.688 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:48 +0000 (0:00:00.017) 0:00:00.112 ***** 2021-01-27T16:27:51.000 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi106.front.sepia.ceph.com] 2021-01-27T16:27:51.074 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:51 +0000 (0:00:02.386) 0:00:02.498 ***** 2021-01-27T16:27:51.301 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] 2021-01-27T16:27:51.343 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-27T16:27:51.345 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T16:27:51.379 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:51 +0000 (0:00:00.304) 0:00:02.803 ***** 2021-01-27T16:27:51.415 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:51 +0000 (0:00:00.036) 0:00:02.839 ***** 2021-01-27T16:27:51.505 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T16:27:51.540 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:51 +0000 (0:00:00.125) 0:00:02.965 ***** 2021-01-27T16:27:51.965 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-27T16:27:51.967 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} changed: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-27T16:27:52.005 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.465) 0:00:03.430 ***** 2021-01-27T16:27:52.039 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.033) 0:00:03.464 ***** 2021-01-27T16:27:52.316 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-27T16:27:52.318 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.066692", "end": "2021-01-27 16:27:52.139011", "rc": 0, "start": "2021-01-27 16:27:52.072319", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T16:27:52.353 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.313) 0:00:03.777 ***** 2021-01-27T16:27:52.359 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.091655", "end": "2021-01-27 16:27:52.597990", "rc": 0, "start": "2021-01-27 16:27:52.506335", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-27T16:27:52.396 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.043) 0:00:03.821 ***** 2021-01-27T16:27:52.626 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-27T16:27:52.628 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:27:52.666 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.269) 0:00:04.091 ***** 2021-01-27T16:27:52.673 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:27:52.715 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:52 +0000 (0:00:00.048) 0:00:04.140 ***** 2021-01-27T16:27:53.382 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-27T16:27:53.384 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764872.7324033-198544316374372/source", "state": "file", "uid": 0} 2021-01-27T16:27:53.433 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:53 +0000 (0:00:00.717) 0:00:04.857 ***** 2021-01-27T16:27:53.441 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764872.6804013-103769262695974/source", "state": "file", "uid": 0} 2021-01-27T16:27:53.480 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:53 +0000 (0:00:00.046) 0:00:04.904 ***** 2021-01-27T16:27:53.789 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-27T16:27:53.791 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T16:27:53.792 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T16:27:53.829 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-27T16:27:53.831 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-27T16:27:53.941 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-01-27T16:27:53.948 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-27T16:27:54.091 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:54 +0000 (0:00:00.611) 0:00:05.516 ***** 2021-01-27T16:27:54.124 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:54 +0000 (0:00:00.032) 0:00:05.548 ***** 2021-01-27T16:27:54.958 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi094.front.sepia.ceph.com] 2021-01-27T16:27:55.003 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-01-27T16:27:55.049 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-27T16:27:55.051 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.925) 0:00:06.474 ***** 2021-01-27T16:27:55.124 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.074) 0:00:06.549 ***** 2021-01-27T16:27:55.618 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-27T16:27:55.620 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.348152", "end": "2021-01-27 16:27:55.589281", "rc": 0, "start": "2021-01-27 16:27:55.241129", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.303302", "end": "2021-01-27 16:27:55.589136", "rc": 0, "start": "2021-01-27 16:27:55.285834", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T16:27:55.674 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.550) 0:00:07.099 ***** 2021-01-27T16:27:55.713 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.038) 0:00:07.138 ***** 2021-01-27T16:27:55.824 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-27T16:27:55.825 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014454", "end": "2021-01-27 16:27:55.640113", "failed_when_result": false, "rc": 0, "start": "2021-01-27 16:27:55.625659", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T16:27:55.863 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.149) 0:00:07.287 ***** 2021-01-27T16:27:55.870 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008831", "end": "2021-01-27 16:27:56.101109", "failed_when_result": false, "rc": 0, "start": "2021-01-27 16:27:56.092278", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-27T16:27:55.907 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.043) 0:00:07.331 ***** 2021-01-27T16:27:55.914 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-27T16:27:55.916 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T16:27:55.951 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.044) 0:00:07.376 ***** 2021-01-27T16:27:55.958 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-27T16:27:55.993 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:55 +0000 (0:00:00.041) 0:00:07.418 ***** 2021-01-27T16:27:55.999 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-27T16:27:56.000 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.034 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.040) 0:00:07.458 ***** 2021-01-27T16:27:56.040 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.073 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.039) 0:00:07.498 ***** 2021-01-27T16:27:56.078 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-27T16:27:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.114 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.040) 0:00:07.538 ***** 2021-01-27T16:27:56.120 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.155 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.041) 0:00:07.580 ***** 2021-01-27T16:27:56.167 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-27T16:27:56.168 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.202 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.046) 0:00:07.626 ***** 2021-01-27T16:27:56.208 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.244 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.042) 0:00:07.669 ***** 2021-01-27T16:27:56.250 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-27T16:27:56.252 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.293 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.048) 0:00:07.717 ***** 2021-01-27T16:27:56.299 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.336 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.043) 0:00:07.760 ***** 2021-01-27T16:27:56.341 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-27T16:27:56.343 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.377 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.041) 0:00:07.802 ***** 2021-01-27T16:27:56.384 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:56 +0000 (0:00:00.042) 0:00:07.844 ***** 2021-01-27T16:27:56.428 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-27T16:27:56.429 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.440 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.441 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.452 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.453 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.463 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.465 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.475 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.486 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.487 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.488 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.loca 2021-01-27T16:27:56.489 INFO:teuthology.task.ansible.out:l mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.499 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.501 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f24 2021-01-27T16:27:56.502 INFO:teuthology.task.ansible.out:8e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.511 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.513 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf 2021-01-27T16:27:56.514 INFO:teuthology.task.ansible.out:13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.524 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.524 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.525 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.536 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.537 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 2 2021-01-27T16:27:56.539 INFO:teuthology.task.ansible.out:0058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.548 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.550 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.560 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.562 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQ 2021-01-27T16:27:56.564 INFO:teuthology.task.ansible.out:ob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was F 2021-01-27T16:27:56.565 INFO:teuthology.task.ansible.out:alse"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.574 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.576 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.588 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.599 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.600 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.611 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.612 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.613 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein 2021-01-27T16:27:56.615 INFO:teuthology.task.ansible.out:@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.625 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.626 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.627 INFO:teuthology.task.ansible.out: skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.629 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.641 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.642 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.653 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.655 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.655 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.657 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.667 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.668 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.669 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.680 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.682 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.685 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.696 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.697 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.698 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-01-27T16:27:56.700 INFO:teuthology.task.ansible.out: "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.709 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.710 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.711 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.722 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.724 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.735 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.737 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.737 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.739 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.739 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.750 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.751 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.752 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.763 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.765 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.766 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.776 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.778 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.778 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.779 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01 2021-01-27T16:27:56.780 INFO:teuthology.task.ansible.out:@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.790 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.792 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.802 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.804 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.814 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.816 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.826 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.828 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.828 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.839 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.841 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.852 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.854 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.864 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.866 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.877 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.877 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.878 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.878 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.879 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.889 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.891 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.902 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.904 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.904 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bd 2021-01-27T16:27:56.905 INFO:teuthology.task.ansible.out:d5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.915 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.916 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.917 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.927 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.930 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.939 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.941 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.951 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.953 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.953 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] 2021-01-27T16:27:56.955 INFO:teuthology.task.ansible.out: => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.965 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.967 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.977 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.978 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.978 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.979 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.979 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.992 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:56.992 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.003 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.005 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.015 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.018 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.028 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.030 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.040 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.042 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.042 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.053 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.055 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.055 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.056 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": " 2021-01-27T16:27:57.057 INFO:teuthology.task.ansible.out:root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.067 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.068 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.070 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.080 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.081 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.092 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.094 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.104 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.105 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.105 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.106 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.107 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.118 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.119 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.130 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.132 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.132 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.143 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.145 INFO:teuthology.task.ansible.out: skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.145 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.156 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.158 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.168 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.170 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.170 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.171 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item 2021-01-27T16:27:57.172 INFO:teuthology.task.ansible.out:": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.181 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.183 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.199 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.200 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.237 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.817) 0:00:08.662 ***** 2021-01-27T16:27:57.244 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.246 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.263 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T16:27:57.298 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.060) 0:00:08.723 ***** 2021-01-27T16:27:57.332 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.033) 0:00:08.756 ***** 2021-01-27T16:27:57.338 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T16:27:57.340 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.379 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.047) 0:00:08.804 ***** 2021-01-27T16:27:57.385 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-27T16:27:57.428 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.048) 0:00:08.853 ***** 2021-01-27T16:27:57.434 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T16:27:57.436 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.471 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.043) 0:00:08.896 ***** 2021-01-27T16:27:57.477 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-27T16:27:57.479 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.519 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.047) 0:00:08.943 ***** 2021-01-27T16:27:57.525 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T16:27:57.526 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.560 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.041) 0:00:08.985 ***** 2021-01-27T16:27:57.568 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-27T16:27:57.570 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.605 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.044) 0:00:09.029 ***** 2021-01-27T16:27:57.610 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T16:27:57.612 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.043) 0:00:09.072 ***** 2021-01-27T16:27:57.654 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-27T16:27:57.656 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.691 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.043) 0:00:09.115 ***** 2021-01-27T16:27:57.697 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-27T16:27:57.699 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.736 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.044) 0:00:09.160 ***** 2021-01-27T16:27:57.742 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-27T16:27:57.744 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.780 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.044) 0:00:09.205 ***** 2021-01-27T16:27:57.786 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-27T16:27:57.787 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.789 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.800 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.801 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi094.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.838 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:57 +0000 (0:00:00.057) 0:00:09.263 ***** 2021-01-27T16:27:57.844 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.846 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.846 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.847 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.847 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.848 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.848 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.848 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.859 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.861 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.871 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.883 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.894 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.896 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.896 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.897 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.907 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.909 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.920 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.922 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.922 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.934 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.935 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.936 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.947 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.949 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.949 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.950 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.960 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.962 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.973 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.974 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.975 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.975 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.986 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.988 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:57.998 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.000 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.011 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.012 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.016 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.054 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.215) 0:00:09.478 ***** 2021-01-27T16:27:58.060 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.062 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.063 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.063 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.063 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.064 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.075 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.076 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.088 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.089 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.099 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.100 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.111 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.112 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.157 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.103) 0:00:09.582 ***** 2021-01-27T16:27:58.632 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-27T16:27:58.634 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-27T16:27:58.672 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.514) 0:00:10.097 ***** 2021-01-27T16:27:58.706 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.033) 0:00:10.131 ***** 2021-01-27T16:27:58.713 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-27T16:27:58.714 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => { "msg": "Host smithi094.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T16:27:58.753 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.046) 0:00:10.178 ***** 2021-01-27T16:27:58.760 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => { "msg": "Host smithi106.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-27T16:27:58.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.060) 0:00:10.238 ***** 2021-01-27T16:27:58.819 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-27T16:27:58.821 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T16:27:58.857 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.043) 0:00:10.281 ***** 2021-01-27T16:27:58.865 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-27T16:27:58.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.044) 0:00:10.326 ***** 2021-01-27T16:27:58.907 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-27T16:27:58.909 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.944 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.043) 0:00:10.369 ***** 2021-01-27T16:27:58.951 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:58.987 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:58 +0000 (0:00:00.043) 0:00:10.412 ***** 2021-01-27T16:27:58.993 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-27T16:27:58.994 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.029 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.041) 0:00:10.453 ***** 2021-01-27T16:27:59.035 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.071 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.042) 0:00:10.496 ***** 2021-01-27T16:27:59.077 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-27T16:27:59.079 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.117 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.045) 0:00:10.541 ***** 2021-01-27T16:27:59.123 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.159 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.042) 0:00:10.583 ***** 2021-01-27T16:27:59.170 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-27T16:27:59.172 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.205 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.046) 0:00:10.630 ***** 2021-01-27T16:27:59.212 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.248 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:10.673 ***** 2021-01-27T16:27:59.253 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-27T16:27:59.255 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.041) 0:00:10.715 ***** 2021-01-27T16:27:59.296 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.332 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.041) 0:00:10.756 ***** 2021-01-27T16:27:59.337 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-27T16:27:59.339 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.373 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.041) 0:00:10.797 ***** 2021-01-27T16:27:59.378 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.041) 0:00:10.839 ***** 2021-01-27T16:27:59.421 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-27T16:27:59.422 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.460 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.045) 0:00:10.884 ***** 2021-01-27T16:27:59.465 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.502 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.042) 0:00:10.926 ***** 2021-01-27T16:27:59.508 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-27T16:27:59.509 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.544 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.042) 0:00:10.969 ***** 2021-01-27T16:27:59.550 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.587 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.042) 0:00:11.011 ***** 2021-01-27T16:27:59.592 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-27T16:27:59.594 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:27:59.630 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:11.054 ***** 2021-01-27T16:27:59.636 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:27:59.638 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:27:59.674 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.044) 0:00:11.098 ***** 2021-01-27T16:27:59.682 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-27T16:27:59.683 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.723 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.049) 0:00:11.148 ***** 2021-01-27T16:27:59.730 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.767 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:11.192 ***** 2021-01-27T16:27:59.774 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-27T16:27:59.776 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.816 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.048) 0:00:11.240 ***** 2021-01-27T16:27:59.823 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.859 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:11.283 ***** 2021-01-27T16:27:59.865 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-27T16:27:59.867 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:27:59.903 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.044) 0:00:11.328 ***** 2021-01-27T16:27:59.910 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:27:59.947 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:11.371 ***** 2021-01-27T16:27:59.952 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-27T16:27:59.954 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:27:59.990 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:27:59 +0000 (0:00:00.043) 0:00:11.414 ***** 2021-01-27T16:27:59.996 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.032 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.457 ***** 2021-01-27T16:28:00.038 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-27T16:28:00.040 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:00.076 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:11.500 ***** 2021-01-27T16:28:00.084 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:00.118 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.543 ***** 2021-01-27T16:28:00.124 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-27T16:28:00.126 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.161 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.586 ***** 2021-01-27T16:28:00.168 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.203 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.041) 0:00:11.628 ***** 2021-01-27T16:28:00.208 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-27T16:28:00.210 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.244 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.041) 0:00:11.669 ***** 2021-01-27T16:28:00.250 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.286 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.041) 0:00:11.711 ***** 2021-01-27T16:28:00.293 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-27T16:28:00.295 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.330 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.044) 0:00:11.755 ***** 2021-01-27T16:28:00.338 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.374 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:11.798 ***** 2021-01-27T16:28:00.380 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-27T16:28:00.381 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.416 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.841 ***** 2021-01-27T16:28:00.423 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.462 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.045) 0:00:11.886 ***** 2021-01-27T16:28:00.468 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-27T16:28:00.470 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:00.504 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.929 ***** 2021-01-27T16:28:00.511 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:00.547 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:11.971 ***** 2021-01-27T16:28:00.553 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T16:28:00.555 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.590 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:12.015 ***** 2021-01-27T16:28:00.598 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.634 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:12.058 ***** 2021-01-27T16:28:00.640 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-27T16:28:00.642 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.677 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:12.101 ***** 2021-01-27T16:28:00.684 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.720 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:12.145 ***** 2021-01-27T16:28:00.726 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-27T16:28:00.727 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:12.187 ***** 2021-01-27T16:28:00.771 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.806 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.043) 0:00:12.230 ***** 2021-01-27T16:28:00.812 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-27T16:28:00.814 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.848 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:12.273 ***** 2021-01-27T16:28:00.854 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.890 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.041) 0:00:12.315 ***** 2021-01-27T16:28:00.896 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-27T16:28:00.898 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.932 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.042) 0:00:12.357 ***** 2021-01-27T16:28:00.939 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:00.974 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:00 +0000 (0:00:00.041) 0:00:12.399 ***** 2021-01-27T16:28:00.979 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-27T16:28:00.981 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.016 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.041) 0:00:12.441 ***** 2021-01-27T16:28:01.023 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.058 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.041) 0:00:12.482 ***** 2021-01-27T16:28:01.064 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-27T16:28:01.066 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:01.104 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.046) 0:00:12.529 ***** 2021-01-27T16:28:01.110 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:01.146 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.042) 0:00:12.571 ***** 2021-01-27T16:28:01.152 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-27T16:28:01.154 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.189 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.042) 0:00:12.614 ***** 2021-01-27T16:28:01.196 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.232 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.042) 0:00:12.656 ***** 2021-01-27T16:28:01.237 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-27T16:28:01.239 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.274 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.042) 0:00:12.698 ***** 2021-01-27T16:28:01.280 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.316 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.042) 0:00:12.740 ***** 2021-01-27T16:28:01.322 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-27T16:28:01.323 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.041) 0:00:12.782 ***** 2021-01-27T16:28:01.363 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.401 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.043) 0:00:12.825 ***** 2021-01-27T16:28:01.407 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-27T16:28:01.408 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.447 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.045) 0:00:12.871 ***** 2021-01-27T16:28:01.454 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.456 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.498 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.051) 0:00:12.923 ***** 2021-01-27T16:28:01.506 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-27T16:28:01.508 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.548 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.049) 0:00:12.972 ***** 2021-01-27T16:28:01.555 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.557 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.592 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.044) 0:00:13.017 ***** 2021-01-27T16:28:01.599 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-27T16:28:01.601 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.636 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.043) 0:00:13.060 ***** 2021-01-27T16:28:01.643 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.681 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.044) 0:00:13.105 ***** 2021-01-27T16:28:01.781 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T16:28:01.782 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015270", "end": "2021-01-27 16:28:01.600933", "rc": 0, "start": "2021-01-27 16:28:01.585663", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T16:28:01.823 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.142) 0:00:13.248 ***** 2021-01-27T16:28:01.830 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015691", "end": "2021-01-27 16:28:02.081607", "rc": 0, "start": "2021-01-27 16:28:02.065916", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-27T16:28:01.867 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.043) 0:00:13.291 ***** 2021-01-27T16:28:01.874 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-27T16:28:01.876 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.911 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.044) 0:00:13.336 ***** 2021-01-27T16:28:01.919 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:01.957 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:01 +0000 (0:00:00.046) 0:00:13.382 ***** 2021-01-27T16:28:01.964 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-27T16:28:01.966 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.045) 0:00:13.427 ***** 2021-01-27T16:28:02.010 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.048 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.044) 0:00:13.472 ***** 2021-01-27T16:28:02.054 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-27T16:28:02.056 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.044) 0:00:13.517 ***** 2021-01-27T16:28:02.099 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.140 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.047) 0:00:13.565 ***** 2021-01-27T16:28:02.150 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-27T16:28:02.152 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.189 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.048) 0:00:13.613 ***** 2021-01-27T16:28:02.200 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.240 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.051) 0:00:13.664 ***** 2021-01-27T16:28:02.248 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-27T16:28:02.249 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.290 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.050) 0:00:13.714 ***** 2021-01-27T16:28:02.296 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.334 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.043) 0:00:13.758 ***** 2021-01-27T16:28:02.339 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-27T16:28:02.341 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.376 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.042) 0:00:13.801 ***** 2021-01-27T16:28:02.384 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.421 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.045) 0:00:13.846 ***** 2021-01-27T16:28:02.430 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-27T16:28:02.432 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.469 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.047) 0:00:13.894 ***** 2021-01-27T16:28:02.477 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.524 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.053) 0:00:13.948 ***** 2021-01-27T16:28:02.688 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T16:28:02.690 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.084231", "end": "2021-01-27 16:28:02.500443", "rc": 0, "start": "2021-01-27 16:28:02.416212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:02.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.207) 0:00:14.155 ***** 2021-01-27T16:28:02.758 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:02.798 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:02 +0000 (0:00:00.067) 0:00:14.222 ***** 2021-01-27T16:28:03.035 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T16:28:03.037 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.096639", "end": "2021-01-27 16:28:02.850664", "rc": 0, "start": "2021-01-27 16:28:02.754025", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:03.072 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:03 +0000 (0:00:00.274) 0:00:14.497 ***** 2021-01-27T16:28:03.257 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-27T16:28:03.259 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.599110", "end": "2021-01-27 16:28:03.500450", "rc": 0, "start": "2021-01-27 16:28:02.901340", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:03.294 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:03 +0000 (0:00:00.222) 0:00:14.719 ***** 2021-01-27T16:28:03.321 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-27T16:28:03.323 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:03.357 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:03 +0000 (0:00:00.062) 0:00:14.781 ***** 2021-01-27T16:28:03.561 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-27T16:28:03.563 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.075612", "end": "2021-01-27 16:28:03.810848", "rc": 0, "start": "2021-01-27 16:28:03.735236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:03.601 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:03 +0000 (0:00:00.244) 0:00:15.025 ***** 2021-01-27T16:28:06.603 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-27T16:28:06.605 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:06.642 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:06 +0000 (0:00:03.040) 0:00:18.066 ***** 2021-01-27T16:28:06.880 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:06.918 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:06 +0000 (0:00:00.276) 0:00:18.343 ***** 2021-01-27T16:28:07.298 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T16:28:07.300 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:07.335 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:07 +0000 (0:00:00.417) 0:00:18.760 ***** 2021-01-27T16:28:07.362 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-27T16:28:07.364 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:07.397 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:07 +0000 (0:00:00.062) 0:00:18.822 ***** 2021-01-27T16:28:07.594 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-27T16:28:07.596 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:07.633 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:07 +0000 (0:00:00.235) 0:00:19.057 ***** 2021-01-27T16:28:07.660 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:07.699 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:07 +0000 (0:00:00.065) 0:00:19.123 ***** 2021-01-27T16:28:07.716 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-27T16:28:07.718 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T16:28:07.775 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:07 +0000 (0:00:00.076) 0:00:19.199 ***** 2021-01-27T16:28:08.015 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-27T16:28:08.052 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:08 +0000 (0:00:00.277) 0:00:19.477 ***** 2021-01-27T16:28:08.432 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-27T16:28:08.434 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:08.469 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:08 +0000 (0:00:00.416) 0:00:19.894 ***** 2021-01-27T16:28:08.683 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:08.721 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:08 +0000 (0:00:00.251) 0:00:20.145 ***** 2021-01-27T16:28:08.800 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T16:28:08.802 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T16:28:09.053 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-27T16:28:09.086 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T16:28:09.346 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-27T16:28:09.368 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T16:28:09.405 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:09 +0000 (0:00:00.684) 0:00:20.829 ***** 2021-01-27T16:28:09.526 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T16:28:09.528 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:28:09.562 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:09 +0000 (0:00:00.157) 0:00:20.987 ***** 2021-01-27T16:28:09.610 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-27T16:28:09.612 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-27T16:28:09.651 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:09 +0000 (0:00:00.088) 0:00:21.076 ***** 2021-01-27T16:28:09.772 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-27T16:28:09.774 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:28:09.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:09 +0000 (0:00:00.161) 0:00:21.237 ***** 2021-01-27T16:28:09.871 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T16:28:09.873 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T16:28:10.113 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-27T16:28:10.124 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T16:28:10.386 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-27T16:28:10.407 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T16:28:10.446 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.633) 0:00:21.870 ***** 2021-01-27T16:28:10.484 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T16:28:10.485 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T16:28:10.518 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.072) 0:00:21.943 ***** 2021-01-27T16:28:10.548 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T16:28:10.550 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.582 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.063) 0:00:22.006 ***** 2021-01-27T16:28:10.609 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:10.644 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.062) 0:00:22.069 ***** 2021-01-27T16:28:10.662 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-27T16:28:10.664 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-27T16:28:10.701 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.056) 0:00:22.126 ***** 2021-01-27T16:28:10.707 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T16:28:10.708 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.709 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.745 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.044) 0:00:22.170 ***** 2021-01-27T16:28:10.753 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-27T16:28:10.755 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-27T16:28:10.789 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.043) 0:00:22.213 ***** 2021-01-27T16:28:10.795 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T16:28:10.796 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.831 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.042) 0:00:22.256 ***** 2021-01-27T16:28:10.837 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-27T16:28:10.839 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.043) 0:00:22.299 ***** 2021-01-27T16:28:10.901 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-27T16:28:10.902 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:10.936 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:10 +0000 (0:00:00.061) 0:00:22.360 ***** 2021-01-27T16:28:10.973 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-27T16:28:10.975 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.984 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.995 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:10.997 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:11.035 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:11 +0000 (0:00:00.099) 0:00:22.460 ***** 2021-01-27T16:28:11.062 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-27T16:28:11.063 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:11.099 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:11 +0000 (0:00:00.063) 0:00:22.523 ***** 2021-01-27T16:28:11.498 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-27T16:28:11.500 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:11.537 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:11 +0000 (0:00:00.437) 0:00:22.961 ***** 2021-01-27T16:28:11.751 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:11.788 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:11 +0000 (0:00:00.250) 0:00:23.212 ***** 2021-01-27T16:28:11.845 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-27T16:28:11.980 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} Wednesday 27 January 2021 16:28:11 +0000 (0:00:00.095) 0:00:23.308 ***** 2021-01-27T16:28:12.076 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-27T16:28:12.113 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.229) 0:00:23.538 ***** 2021-01-27T16:28:12.182 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T16:28:12.184 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T16:28:12.219 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.106) 0:00:23.644 ***** 2021-01-27T16:28:12.361 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T16:28:12.363 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T16:28:12.435 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-27T16:28:12.437 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-27T16:28:12.472 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.252) 0:00:23.896 ***** 2021-01-27T16:28:12.478 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T16:28:12.479 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T16:28:12.517 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.045) 0:00:23.942 ***** 2021-01-27T16:28:12.544 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T16:28:12.545 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:12.579 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.061) 0:00:24.003 ***** 2021-01-27T16:28:12.611 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi094.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:12.613 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi106.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-27T16:28:12.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.068) 0:00:24.072 ***** 2021-01-27T16:28:12.675 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:12.710 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.062) 0:00:24.134 ***** 2021-01-27T16:28:12.728 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-27T16:28:12.730 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-27T16:28:12.767 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.056) 0:00:24.191 ***** 2021-01-27T16:28:12.793 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-27T16:28:12.794 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:12.828 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.061) 0:00:24.253 ***** 2021-01-27T16:28:12.855 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-27T16:28:12.856 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-27T16:28:12.891 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.062) 0:00:24.315 ***** 2021-01-27T16:28:12.928 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-27T16:28:12.929 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:12.964 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:12 +0000 (0:00:00.072) 0:00:24.388 ***** 2021-01-27T16:28:13.022 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-27T16:28:13.024 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T16:28:13.063 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.099) 0:00:24.488 ***** 2021-01-27T16:28:13.278 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-27T16:28:13.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.250) 0:00:24.738 ***** 2021-01-27T16:28:13.685 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-27T16:28:13.686 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:23 UTC", "ActiveEnterTimestampMonotonic": "16424928", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target -.mount systemd-journald.socket systemd-tmpfiles-setup.service time-sync.target network.target remote-fs.target system.slice basic.target nss-lookup.target var-run.mount local-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:23 UTC", "AssertTimestampMonotonic": "16407698", "Before": "shutdown.target getty@tty1.service xdm.service multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:23 UTC", "Co 2021-01-27T16:28:13.687 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16407697", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "937", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:23 UTC", "ExecMainStartTimestampMonotonic": "16424775", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 16:27:23 UTC] ; stop_time=[n/a] ; pid=937 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 16:27:23 UTC] ; stop_time=[n/a] ; pid=937 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-27T16:28:13.689 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:23 UTC", "InactiveExitTimestampMonotonic": "16424928", "InvocationID": "9fc3e62f42ed44abaa15c3f09ed70a9d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "937", "MemoryAccounting": "yes", "MemoryCurrent": "909312", "MemoryDe 2021-01-27T16:28:13.691 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:23 UTC", "StateChangeTimestampMonotonic": "16424928", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-27T16:28:13.692 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ActiveEnterTimestampMonotonic": "14896679", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-journald.socket -.mount local-fs.target time-sync.target systemd-tmpfiles-setup.service var-run.mount sysinit.target system.slice remote-fs.target basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:22 UTC", "AssertTimestampMonotonic": "14868021", "Before": "multi-user.target getty@tty1.service plymouth-quit.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": " 2021-01-27T16:28:13.694 INFO:teuthology.task.ansible.out:yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ConditionTimestampMonotonic": "14868020", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "885", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ExecMainStartTimestampMonotonic": "14896527", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Wed 2021-01-27 16:27:22 UTC] ; stop_time=[n/a] 2021-01-27T16:28:13.696 INFO:teuthology.task.ansible.out:; pid=885 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Wed 2021-01-27 16:27:22 UTC] ; stop_time=[n/a] ; pid=885 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:22 UTC", "InactiveExitTimestampMonotonic": "14896679", "InvocationID": "77789270fa4945d9bfaf37c203261a75", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLO 2021-01-27T16:28:13.697 INFO:teuthology.task.ansible.out:CKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "885", "MemoryAccounting": "yes", "MemoryCurrent": "987136", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirector 2021-01-27T16:28:13.699 INFO:teuthology.task.ansible.out:yStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:22 UTC", "StateChangeTimestampMonotonic": "14896679", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:28:13.727 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.413) 0:00:25.151 ***** 2021-01-27T16:28:13.759 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.032) 0:00:25.184 ***** 2021-01-27T16:28:13.765 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-27T16:28:13.767 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:13.802 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.042) 0:00:25.227 ***** 2021-01-27T16:28:13.815 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:13.850 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.048) 0:00:25.275 ***** 2021-01-27T16:28:13.856 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-27T16:28:13.858 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:13.894 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.043) 0:00:25.318 ***** 2021-01-27T16:28:13.901 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:13.937 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.043) 0:00:25.362 ***** 2021-01-27T16:28:13.943 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-27T16:28:13.945 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:13.981 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:13 +0000 (0:00:00.044) 0:00:25.406 ***** 2021-01-27T16:28:13.988 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.024 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.043) 0:00:25.449 ***** 2021-01-27T16:28:14.030 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-27T16:28:14.032 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.067 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.492 ***** 2021-01-27T16:28:14.075 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.110 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.534 ***** 2021-01-27T16:28:14.115 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-27T16:28:14.117 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.152 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.577 ***** 2021-01-27T16:28:14.158 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.194 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.041) 0:00:25.619 ***** 2021-01-27T16:28:14.199 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-27T16:28:14.201 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.236 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.041) 0:00:25.660 ***** 2021-01-27T16:28:14.242 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.278 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.702 ***** 2021-01-27T16:28:14.284 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-27T16:28:14.285 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.321 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.745 ***** 2021-01-27T16:28:14.328 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.363 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.041) 0:00:25.787 ***** 2021-01-27T16:28:14.365 INFO:teuthology.task.ansible.out: 2021-01-27T16:28:14.369 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-27T16:28:14.371 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.043) 0:00:25.831 ***** 2021-01-27T16:28:14.412 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.452 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.045) 0:00:25.877 ***** 2021-01-27T16:28:14.458 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-27T16:28:14.460 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.494 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.919 ***** 2021-01-27T16:28:14.501 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.537 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:25.962 ***** 2021-01-27T16:28:14.543 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-27T16:28:14.544 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.580 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:26.004 ***** 2021-01-27T16:28:14.586 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:14.622 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.042) 0:00:26.046 ***** 2021-01-27T16:28:14.628 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-27T16:28:14.630 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T16:28:14.667 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.045) 0:00:26.092 ***** 2021-01-27T16:28:14.674 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-27T16:28:14.712 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.044) 0:00:26.136 ***** 2021-01-27T16:28:14.717 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-27T16:28:14.718 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T16:28:14.756 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.044) 0:00:26.181 ***** 2021-01-27T16:28:14.764 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-27T16:28:14.802 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.045) 0:00:26.227 ***** 2021-01-27T16:28:14.808 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-27T16:28:14.809 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T16:28:14.846 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.043) 0:00:26.271 ***** 2021-01-27T16:28:14.853 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-27T16:28:14.891 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.044) 0:00:26.315 ***** 2021-01-27T16:28:14.897 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-27T16:28:14.899 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T16:28:14.934 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.043) 0:00:26.358 ***** 2021-01-27T16:28:14.940 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-27T16:28:14.978 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:14 +0000 (0:00:00.043) 0:00:26.402 ***** 2021-01-27T16:28:15.056 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-27T16:28:15.058 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T16:28:15.100 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.121) 0:00:26.524 ***** 2021-01-27T16:28:15.106 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-27T16:28:15.143 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.042) 0:00:26.567 ***** 2021-01-27T16:28:15.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-27T16:28:15.234 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T16:28:15.269 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.125) 0:00:26.693 ***** 2021-01-27T16:28:15.276 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-27T16:28:15.311 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.042) 0:00:26.736 ***** 2021-01-27T16:28:15.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-27T16:28:15.320 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:15.354 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.043) 0:00:26.779 ***** 2021-01-27T16:28:15.361 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:15.397 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.043) 0:00:26.822 ***** 2021-01-27T16:28:15.403 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-27T16:28:15.405 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:15.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.042) 0:00:26.864 ***** 2021-01-27T16:28:15.446 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:15.482 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.042) 0:00:26.907 ***** 2021-01-27T16:28:15.592 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-27T16:28:15.594 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T16:28:15.629 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.146) 0:00:27.053 ***** 2021-01-27T16:28:15.636 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-27T16:28:15.672 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:15 +0000 (0:00:00.043) 0:00:27.097 ***** 2021-01-27T16:28:16.156 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-27T16:28:16.157 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T16:28:16.193 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:16 +0000 (0:00:00.520) 0:00:27.617 ***** 2021-01-27T16:28:16.201 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-27T16:28:16.239 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:16 +0000 (0:00:00.046) 0:00:27.664 ***** 2021-01-27T16:28:16.247 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-27T16:28:16.249 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi094"}, "changed": false} 2021-01-27T16:28:16.297 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:16 +0000 (0:00:00.057) 0:00:27.722 ***** 2021-01-27T16:28:16.306 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi106"}, "changed": false} 2021-01-27T16:28:16.344 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:16 +0000 (0:00:00.047) 0:00:27.769 ***** 2021-01-27T16:28:17.083 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-27T16:28:17.084 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi094.front.sepia.ceph.com", "ansible_hostname": "smithi094", "ansible_nodename": "smithi094"}, "changed": true, "name": "smithi094"} 2021-01-27T16:28:17.117 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.772) 0:00:28.541 ***** 2021-01-27T16:28:17.124 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi106.front.sepia.ceph.com", "ansible_hostname": "smithi106", "ansible_nodename": "smithi106"}, "changed": true, "name": "smithi106"} 2021-01-27T16:28:17.161 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.043) 0:00:28.585 ***** 2021-01-27T16:28:17.437 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-27T16:28:17.438 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T16:28:17.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.312) 0:00:28.898 ***** 2021-01-27T16:28:17.481 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-27T16:28:17.519 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.045) 0:00:28.944 ***** 2021-01-27T16:28:17.785 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-27T16:28:17.787 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T16:28:17.823 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.303) 0:00:29.248 ***** 2021-01-27T16:28:17.841 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-27T16:28:17.878 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:17 +0000 (0:00:00.054) 0:00:29.302 ***** 2021-01-27T16:28:18.447 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-27T16:28:18.449 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T16:28:18.483 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.605) 0:00:29.908 ***** 2021-01-27T16:28:18.511 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-27T16:28:18.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.549 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.065) 0:00:29.974 ***** 2021-01-27T16:28:18.583 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.033) 0:00:30.007 ***** 2021-01-27T16:28:18.588 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T16:28:18.590 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.625 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.042) 0:00:30.049 ***** 2021-01-27T16:28:18.632 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-27T16:28:18.633 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.667 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.042) 0:00:30.091 ***** 2021-01-27T16:28:18.673 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T16:28:18.674 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.710 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.042) 0:00:30.134 ***** 2021-01-27T16:28:18.715 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T16:28:18.717 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.752 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.041) 0:00:30.176 ***** 2021-01-27T16:28:18.757 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T16:28:18.759 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.794 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.041) 0:00:30.218 ***** 2021-01-27T16:28:18.800 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T16:28:18.802 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.838 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.044) 0:00:30.263 ***** 2021-01-27T16:28:18.846 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T16:28:18.848 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.886 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.047) 0:00:30.310 ***** 2021-01-27T16:28:18.893 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T16:28:18.895 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.930 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.043) 0:00:30.354 ***** 2021-01-27T16:28:18.936 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T16:28:18.938 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:18.973 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:18 +0000 (0:00:00.043) 0:00:30.398 ***** 2021-01-27T16:28:18.979 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T16:28:18.981 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.016 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:30.440 ***** 2021-01-27T16:28:19.022 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T16:28:19.024 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.059 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:30.483 ***** 2021-01-27T16:28:19.065 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T16:28:19.067 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.102 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.043) 0:00:30.527 ***** 2021-01-27T16:28:19.108 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T16:28:19.110 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.144 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:30.568 ***** 2021-01-27T16:28:19.157 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T16:28:19.158 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.191 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.047) 0:00:30.616 ***** 2021-01-27T16:28:19.197 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T16:28:19.330 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.138) 0:00:30.755 ***** 2021-01-27T16:28:19.336 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-27T16:28:19.337 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.373 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:30.797 ***** 2021-01-27T16:28:19.378 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T16:28:19.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:30.839 ***** 2021-01-27T16:28:19.421 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-27T16:28:19.456 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:30.881 ***** 2021-01-27T16:28:19.463 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T16:28:19.499 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:30.923 ***** 2021-01-27T16:28:19.504 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-27T16:28:19.540 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:30.965 ***** 2021-01-27T16:28:19.545 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-27T16:28:19.547 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.582 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:31.007 ***** 2021-01-27T16:28:19.589 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-27T16:28:19.626 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.043) 0:00:31.051 ***** 2021-01-27T16:28:19.633 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-27T16:28:19.634 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.670 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.043) 0:00:31.094 ***** 2021-01-27T16:28:19.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-27T16:28:19.677 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.711 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:31.136 ***** 2021-01-27T16:28:19.716 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-27T16:28:19.718 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.753 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:31.178 ***** 2021-01-27T16:28:19.759 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-27T16:28:19.761 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.795 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.041) 0:00:31.220 ***** 2021-01-27T16:28:19.802 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:28:19.804 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.838 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:31.262 ***** 2021-01-27T16:28:19.844 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-27T16:28:19.847 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.881 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.043) 0:00:31.306 ***** 2021-01-27T16:28:19.887 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-27T16:28:19.889 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.927 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.045) 0:00:31.351 ***** 2021-01-27T16:28:19.933 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:28:19.935 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:19.969 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:19 +0000 (0:00:00.042) 0:00:31.393 ***** 2021-01-27T16:28:19.975 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-27T16:28:19.977 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.012 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.043) 0:00:31.437 ***** 2021-01-27T16:28:20.019 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-27T16:28:20.020 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.056 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.044) 0:00:31.481 ***** 2021-01-27T16:28:20.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-27T16:28:20.064 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.098 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.523 ***** 2021-01-27T16:28:20.104 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-27T16:28:20.106 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.141 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.566 ***** 2021-01-27T16:28:20.147 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T16:28:20.149 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.184 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.608 ***** 2021-01-27T16:28:20.189 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-27T16:28:20.191 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.225 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:31.650 ***** 2021-01-27T16:28:20.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T16:28:20.233 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.266 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:31.691 ***** 2021-01-27T16:28:20.272 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-27T16:28:20.274 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.307 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.040) 0:00:31.732 ***** 2021-01-27T16:28:20.313 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T16:28:20.314 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.348 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.040) 0:00:31.773 ***** 2021-01-27T16:28:20.355 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T16:28:20.357 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.391 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.815 ***** 2021-01-27T16:28:20.396 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T16:28:20.398 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.432 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:31.857 ***** 2021-01-27T16:28:20.438 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T16:28:20.440 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.899 ***** 2021-01-27T16:28:20.481 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T16:28:20.483 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.517 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:31.941 ***** 2021-01-27T16:28:20.523 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T16:28:20.524 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.563 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.046) 0:00:31.988 ***** 2021-01-27T16:28:20.569 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T16:28:20.571 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.606 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:32.030 ***** 2021-01-27T16:28:20.613 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-27T16:28:20.614 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.648 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:32.073 ***** 2021-01-27T16:28:20.654 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T16:28:20.656 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.690 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:32.115 ***** 2021-01-27T16:28:20.696 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T16:28:20.698 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.732 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:32.156 ***** 2021-01-27T16:28:20.737 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T16:28:20.738 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.772 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.040) 0:00:32.197 ***** 2021-01-27T16:28:20.778 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T16:28:20.779 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.814 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:32.238 ***** 2021-01-27T16:28:20.819 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-27T16:28:20.820 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.855 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.040) 0:00:32.279 ***** 2021-01-27T16:28:20.862 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-27T16:28:20.863 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.898 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.043) 0:00:32.323 ***** 2021-01-27T16:28:20.904 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-27T16:28:20.906 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.941 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.042) 0:00:32.365 ***** 2021-01-27T16:28:20.947 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-27T16:28:20.949 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:20.983 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:20 +0000 (0:00:00.041) 0:00:32.407 ***** 2021-01-27T16:28:20.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-27T16:28:20.989 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.023 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.040) 0:00:32.448 ***** 2021-01-27T16:28:21.028 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-27T16:28:21.030 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.064 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.040) 0:00:32.489 ***** 2021-01-27T16:28:21.069 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-27T16:28:21.071 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.105 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.040) 0:00:32.529 ***** 2021-01-27T16:28:21.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-27T16:28:21.113 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.147 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.042) 0:00:32.572 ***** 2021-01-27T16:28:21.152 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-27T16:28:21.154 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.191 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.044) 0:00:32.616 ***** 2021-01-27T16:28:21.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-27T16:28:21.199 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.242 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.050) 0:00:32.667 ***** 2021-01-27T16:28:21.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-27T16:28:21.250 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.285 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.043) 0:00:32.710 ***** 2021-01-27T16:28:21.292 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-27T16:28:21.293 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.329 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.043) 0:00:32.753 ***** 2021-01-27T16:28:21.335 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-27T16:28:21.336 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.042) 0:00:32.796 ***** 2021-01-27T16:28:21.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-27T16:28:21.379 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.420 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.049) 0:00:32.845 ***** 2021-01-27T16:28:21.447 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:21.483 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.062) 0:00:32.908 ***** 2021-01-27T16:28:21.510 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-27T16:28:21.512 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005395", "end": "2021-01-27 16:28:21.331739", "rc": 0, "start": "2021-01-27 16:28:21.326344", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:21.547 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.064) 0:00:32.972 ***** 2021-01-27T16:28:21.574 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T16:28:21.609 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.061) 0:00:33.034 ***** 2021-01-27T16:28:21.626 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-27T16:28:21.628 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004711", "end": "2021-01-27 16:28:21.872667", "rc": 0, "start": "2021-01-27 16:28:21.867956", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:21.664 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.054) 0:00:33.088 ***** 2021-01-27T16:28:21.690 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-27T16:28:21.726 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.062) 0:00:33.151 ***** 2021-01-27T16:28:21.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T16:28:21.923 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T16:28:21.959 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:21 +0000 (0:00:00.232) 0:00:33.383 ***** 2021-01-27T16:28:21.986 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:22.021 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:22 +0000 (0:00:00.062) 0:00:33.446 ***** 2021-01-27T16:28:22.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-27T16:28:22.040 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-27T16:28:22.079 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:22 +0000 (0:00:00.057) 0:00:33.503 ***** 2021-01-27T16:28:22.105 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-27T16:28:22.107 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:22.141 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:22 +0000 (0:00:00.062) 0:00:33.565 ***** 2021-01-27T16:28:23.199 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-27T16:28:23.200 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T16:28:23.210 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-27T16:28:24.157 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T16:28:24.159 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-27T16:28:24.192 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:24 +0000 (0:00:02.050) 0:00:35.616 ***** 2021-01-27T16:28:24.224 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:24 +0000 (0:00:00.032) 0:00:35.648 ***** 2021-01-27T16:28:24.820 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-27T16:28:24.822 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:24.857 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:24 +0000 (0:00:00.633) 0:00:36.281 ***** 2021-01-27T16:28:24.884 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:24.886 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-27T16:28:24.921 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:24 +0000 (0:00:00.063) 0:00:36.345 ***** 2021-01-27T16:28:24.954 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:24 +0000 (0:00:00.033) 0:00:36.379 ***** 2021-01-27T16:28:25.016 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:25 +0000 (0:00:00.061) 0:00:36.440 ***** 2021-01-27T16:28:25.084 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-27T16:28:25.085 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030719", "end": "2021-01-27 16:28:24.900898", "rc": 0, "start": "2021-01-27 16:28:24.870179", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:25.119 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:25 +0000 (0:00:00.103) 0:00:36.544 ***** 2021-01-27T16:28:25.178 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.029087", "end": "2021-01-27 16:28:25.426912", "rc": 0, "start": "2021-01-27 16:28:25.397825", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:25.215 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:25 +0000 (0:00:00.095) 0:00:36.640 ***** 2021-01-27T16:28:27.277 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-27T16:28:27.279 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:27.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:27 +0000 (0:00:02.097) 0:00:38.737 ***** 2021-01-27T16:28:27.319 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:27.356 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:27 +0000 (0:00:00.043) 0:00:38.781 ***** 2021-01-27T16:28:39.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-27T16:28:39.673 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T16:28:39.674 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T16:28:39.707 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:39 +0000 (0:00:12.351) 0:00:51.132 ***** 2021-01-27T16:28:39.714 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-27T16:28:39.716 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T16:28:39.752 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:39 +0000 (0:00:00.044) 0:00:51.177 ***** 2021-01-27T16:28:40.340 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T16:28:40.342 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:40.376 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:40 +0000 (0:00:00.624) 0:00:51.801 ***** 2021-01-27T16:28:40.394 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:40.431 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:40 +0000 (0:00:00.054) 0:00:51.856 ***** 2021-01-27T16:28:40.437 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-27T16:28:40.439 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:40.473 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:40 +0000 (0:00:00.042) 0:00:51.898 ***** 2021-01-27T16:28:40.480 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:40.517 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:40 +0000 (0:00:00.043) 0:00:51.942 ***** 2021-01-27T16:28:49.944 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T16:28:49.945 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.6 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T16:28:49.947 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T16:28:49.948 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.6 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T16:28:49.950 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T16:28:49.988 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:49 +0000 (0:00:09.471) 0:01:01.413 ***** 2021-01-27T16:28:50.101 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-27T16:28:50.103 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-27T16:28:50.104 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-27T16:28:50.106 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-27T16:28:50.140 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.151) 0:01:01.565 ***** 2021-01-27T16:28:50.650 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-27T16:28:50.652 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:50.688 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.547) 0:01:02.113 ***** 2021-01-27T16:28:50.778 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:50.816 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.128) 0:01:02.241 ***** 2021-01-27T16:28:50.823 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T16:28:50.825 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T16:28:50.860 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.044) 0:01:02.285 ***** 2021-01-27T16:28:50.888 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T16:28:50.890 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:50.922 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.061) 0:01:02.346 ***** 2021-01-27T16:28:50.938 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-27T16:28:50.940 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-27T16:28:50.974 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:50 +0000 (0:00:00.052) 0:01:02.399 ***** 2021-01-27T16:28:51.001 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-27T16:28:51.003 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:51.037 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.062) 0:01:02.461 ***** 2021-01-27T16:28:51.052 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-27T16:28:51.054 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T16:28:51.089 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.052) 0:01:02.513 ***** 2021-01-27T16:28:51.167 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-27T16:28:51.203 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.114) 0:01:02.628 ***** 2021-01-27T16:28:51.417 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-27T16:28:51.418 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T16:28:51.454 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.250) 0:01:02.879 ***** 2021-01-27T16:28:51.535 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-27T16:28:51.571 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.117) 0:01:02.996 ***** 2021-01-27T16:28:51.619 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-27T16:28:51.621 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T16:28:51.655 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.084) 0:01:03.080 ***** 2021-01-27T16:28:51.734 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-27T16:28:51.771 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.115) 0:01:03.196 ***** 2021-01-27T16:28:51.788 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-27T16:28:51.790 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:28:51.825 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.053) 0:01:03.249 ***** 2021-01-27T16:28:51.904 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:28:51.942 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:51 +0000 (0:00:00.117) 0:01:03.367 ***** 2021-01-27T16:28:52.084 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T16:28:52.085 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:24 UTC", "ActiveEnterTimestampMonotonic": "17014015", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice remote-fs.target sysinit.target -.mount systemd-journald.socket network.target basic.target nss-lookup.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:23 UTC", "AssertTimestampMonotonic": "16315571", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:23 UTC", "ConditionTimestampMonotonic": "16315571", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T16:28:52.087 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1079", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:24 UTC", "ExecMainStartTimestampMonotonic": "17013971", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-27T16:28:52.088 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:23 UTC", "InactiveExitTimestampMonotonic": "16316870", "InvocationID": "c15a1604cde944139c0b5b62952ae5a9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1079", "MemoryAccounting": "yes", "MemoryCurrent": "9986048", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-01-27T16:28:52.090 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:24 UTC", "StateChangeTimestampMonotonic": "17014015", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec": 2021-01-27T16:28:52.091 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:28:52.122 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.179) 0:01:03.547 ***** 2021-01-27T16:28:52.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T16:28:52.150 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.184 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.061) 0:01:03.609 ***** 2021-01-27T16:28:52.201 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-27T16:28:52.203 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:23 UTC", "ActiveEnterTimestampMonotonic": "15825824", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target -.mount systemd-journald.socket network.target nss-lookup.target system.slice basic.target systemd-tmpfiles-setup.service remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:22 UTC", "AssertTimestampMonotonic": "14763662", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ConditionTimestampMonotonic": "14763662", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-27T16:28:52.204 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1036", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:23 UTC", "ExecMainStartTimestampMonotonic": "15825809", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-27T16:28:52.206 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:22 UTC", "InactiveExitTimestampMonotonic": "14764593", "InvocationID": "b2a91d676b9b417093b5438073673c08", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1036", "MemoryAccounting": "yes", "MemoryCurrent": "10166272", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-27T16:28:52.207 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:23 UTC", "StateChangeTimestampMonotonic": "15825824", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-27T16:28:52.209 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]" 2021-01-27T16:28:52.209 INFO:teuthology.task.ansible.out:, "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:28:52.211 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.246 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.062) 0:01:03.671 ***** 2021-01-27T16:28:52.280 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.033) 0:01:03.704 ***** 2021-01-27T16:28:52.285 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T16:28:52.287 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.323 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:03.748 ***** 2021-01-27T16:28:52.329 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-27T16:28:52.330 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.367 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:03.791 ***** 2021-01-27T16:28:52.373 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T16:28:52.374 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.409 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.042) 0:01:03.834 ***** 2021-01-27T16:28:52.415 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-27T16:28:52.417 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.453 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.044) 0:01:03.878 ***** 2021-01-27T16:28:52.459 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T16:28:52.460 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.495 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.041) 0:01:03.920 ***** 2021-01-27T16:28:52.501 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-27T16:28:52.503 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.539 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:03.963 ***** 2021-01-27T16:28:52.544 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-27T16:28:52.546 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.583 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:04.007 ***** 2021-01-27T16:28:52.589 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-27T16:28:52.590 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.633 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.050) 0:01:04.058 ***** 2021-01-27T16:28:52.649 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T16:28:52.650 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.684 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.050) 0:01:04.108 ***** 2021-01-27T16:28:52.690 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-27T16:28:52.692 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.731 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.046) 0:01:04.155 ***** 2021-01-27T16:28:52.738 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T16:28:52.740 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.776 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.045) 0:01:04.201 ***** 2021-01-27T16:28:52.785 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.820 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:04.244 ***** 2021-01-27T16:28:52.826 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:28:52.827 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.863 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:04.288 ***** 2021-01-27T16:28:52.870 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-27T16:28:52.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.906 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.042) 0:01:04.331 ***** 2021-01-27T16:28:52.913 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T16:28:52.915 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.950 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.043) 0:01:04.374 ***** 2021-01-27T16:28:52.957 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-27T16:28:52.958 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:52.994 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:52 +0000 (0:00:00.044) 0:01:04.419 ***** 2021-01-27T16:28:53.000 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T16:28:53.002 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.038 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.044) 0:01:04.463 ***** 2021-01-27T16:28:53.044 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:28:53.046 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.082 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.043) 0:01:04.507 ***** 2021-01-27T16:28:53.088 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T16:28:53.090 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.125 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.043) 0:01:04.550 ***** 2021-01-27T16:28:53.131 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-27T16:28:53.133 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.168 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:04.592 ***** 2021-01-27T16:28:53.175 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T16:28:53.177 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.212 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.044) 0:01:04.636 ***** 2021-01-27T16:28:53.219 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-27T16:28:53.221 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.256 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.044) 0:01:04.681 ***** 2021-01-27T16:28:53.262 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:53.264 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.303 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.046) 0:01:04.727 ***** 2021-01-27T16:28:53.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-27T16:28:53.311 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.345 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:04.770 ***** 2021-01-27T16:28:53.351 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:53.352 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.387 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:04.812 ***** 2021-01-27T16:28:53.393 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T16:28:53.395 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.429 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:04.854 ***** 2021-01-27T16:28:53.435 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:53.436 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.471 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:04.896 ***** 2021-01-27T16:28:53.477 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:53.478 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.513 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:04.937 ***** 2021-01-27T16:28:53.518 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T16:28:53.519 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.554 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:04.978 ***** 2021-01-27T16:28:53.563 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:53.565 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.599 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.044) 0:01:05.023 ***** 2021-01-27T16:28:53.604 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T16:28:53.605 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.640 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:05.065 ***** 2021-01-27T16:28:53.646 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:53.647 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.683 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:05.107 ***** 2021-01-27T16:28:53.688 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T16:28:53.689 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.724 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:05.148 ***** 2021-01-27T16:28:53.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T16:28:53.731 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.766 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:05.190 ***** 2021-01-27T16:28:53.771 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:53.773 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.807 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.041) 0:01:05.231 ***** 2021-01-27T16:28:53.814 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T16:28:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.849 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:05.274 ***** 2021-01-27T16:28:53.855 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:53.857 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.892 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.042) 0:01:05.317 ***** 2021-01-27T16:28:53.898 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-27T16:28:53.900 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.937 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.044) 0:01:05.361 ***** 2021-01-27T16:28:53.942 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:53.944 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:53.978 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:53 +0000 (0:00:00.040) 0:01:05.402 ***** 2021-01-27T16:28:53.984 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:53.986 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.019 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.041) 0:01:05.443 ***** 2021-01-27T16:28:54.024 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:54.025 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.059 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.040) 0:01:05.484 ***** 2021-01-27T16:28:54.065 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:54.067 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.100 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.040) 0:01:05.525 ***** 2021-01-27T16:28:54.105 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:54.107 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.141 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.040) 0:01:05.566 ***** 2021-01-27T16:28:54.147 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:54.149 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.182 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.041) 0:01:05.607 ***** 2021-01-27T16:28:54.187 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:54.189 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.226 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.043) 0:01:05.651 ***** 2021-01-27T16:28:54.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-27T16:28:54.234 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.271 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.044) 0:01:05.695 ***** 2021-01-27T16:28:54.276 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T16:28:54.277 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.042) 0:01:05.738 ***** 2021-01-27T16:28:54.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-27T16:28:54.320 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.361 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.047) 0:01:05.785 ***** 2021-01-27T16:28:54.387 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-27T16:28:54.391 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.423 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.062) 0:01:05.848 ***** 2021-01-27T16:28:54.439 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T16:28:54.441 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T16:28:54.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.051) 0:01:05.899 ***** 2021-01-27T16:28:54.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-27T16:28:54.482 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.519 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.044) 0:01:05.943 ***** 2021-01-27T16:28:54.651 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-27T16:28:54.653 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-27T16:28:54.699 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.179) 0:01:06.123 ***** 2021-01-27T16:28:54.777 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T16:28:54.779 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T16:28:54.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.113) 0:01:06.237 ***** 2021-01-27T16:28:54.840 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T16:28:54.841 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:54.875 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:54 +0000 (0:00:00.061) 0:01:06.299 ***** 2021-01-27T16:28:54.995 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-27T16:28:54.997 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-27T16:28:55.032 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.156) 0:01:06.456 ***** 2021-01-27T16:28:55.058 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-27T16:28:55.059 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:55.093 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.061) 0:01:06.517 ***** 2021-01-27T16:28:55.212 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-27T16:28:55.214 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T16:28:55.251 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.157) 0:01:06.675 ***** 2021-01-27T16:28:55.403 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-27T16:28:55.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.188) 0:01:06.864 ***** 2021-01-27T16:28:55.561 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-27T16:28:55.563 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T16:28:55.598 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.158) 0:01:07.022 ***** 2021-01-27T16:28:55.749 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-27T16:28:55.787 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.189) 0:01:07.212 ***** 2021-01-27T16:28:55.912 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T16:28:55.913 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T16:28:55.948 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:55 +0000 (0:00:00.160) 0:01:07.373 ***** 2021-01-27T16:28:56.080 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T16:28:56.082 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:28:56.118 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.169) 0:01:07.542 ***** 2021-01-27T16:28:56.124 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-27T16:28:56.126 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-27T16:28:56.162 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:07.586 ***** 2021-01-27T16:28:56.168 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T16:28:56.170 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.209 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.047) 0:01:07.633 ***** 2021-01-27T16:28:56.238 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T16:28:56.240 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.274 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.065) 0:01:07.699 ***** 2021-01-27T16:28:56.291 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-27T16:28:56.293 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:28:56.327 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.053) 0:01:07.752 ***** 2021-01-27T16:28:56.333 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T16:28:56.335 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:07.796 ***** 2021-01-27T16:28:56.378 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-27T16:28:56.380 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:07.839 ***** 2021-01-27T16:28:56.420 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-27T16:28:56.421 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.458 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:07.883 ***** 2021-01-27T16:28:56.465 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-27T16:28:56.466 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.501 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.042) 0:01:07.925 ***** 2021-01-27T16:28:56.506 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-27T16:28:56.508 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.544 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:07.969 ***** 2021-01-27T16:28:56.550 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-27T16:28:56.552 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.588 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:08.013 ***** 2021-01-27T16:28:56.595 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:28:56.597 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-27T16:28:56.631 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.042) 0:01:08.056 ***** 2021-01-27T16:28:56.637 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-27T16:28:56.638 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.675 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.043) 0:01:08.100 ***** 2021-01-27T16:28:56.693 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-27T16:28:56.695 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.704 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.706 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi094.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.741 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.065) 0:01:08.165 ***** 2021-01-27T16:28:56.747 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.749 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi094.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T16:28:56.759 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.761 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.771 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.772 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi094.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.811 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.070) 0:01:08.235 ***** 2021-01-27T16:28:56.817 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.818 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.818 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.820 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.874 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:56 +0000 (0:00:00.063) 0:01:08.299 ***** 2021-01-27T16:28:56.881 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.882 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.893 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.895 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.904 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-27T16:28:56.915 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.926 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.928 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.937 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.948 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.949 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.959 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:56.970 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.011 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.137) 0:01:08.436 ***** 2021-01-27T16:28:57.079 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T16:28:57.081 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006692", "end": "2021-01-27 16:28:57.058196", "rc": 0, "start": "2021-01-27 16:28:57.051504", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T16:28:57.120 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.108) 0:01:08.545 ***** 2021-01-27T16:28:57.157 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T16:28:57.159 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.197 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.077) 0:01:08.622 ***** 2021-01-27T16:28:57.214 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-27T16:28:57.216 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003208", "end": "2021-01-27 16:28:57.185396", "rc": 0, "start": "2021-01-27 16:28:57.182188", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-27T16:28:57.255 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.057) 0:01:08.680 ***** 2021-01-27T16:28:57.261 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.304 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.048) 0:01:08.729 ***** 2021-01-27T16:28:57.310 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-27T16:28:57.312 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.352 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.048) 0:01:08.777 ***** 2021-01-27T16:28:57.358 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T16:28:57.360 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.396 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.043) 0:01:08.820 ***** 2021-01-27T16:28:57.401 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-27T16:28:57.403 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.439 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.042) 0:01:08.863 ***** 2021-01-27T16:28:57.465 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-27T16:28:57.467 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:57.506 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:57 +0000 (0:00:00.067) 0:01:08.930 ***** 2021-01-27T16:28:58.031 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T16:28:58.033 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:28:58.070 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.564) 0:01:09.495 ***** 2021-01-27T16:28:58.100 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T16:28:58.101 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:58.136 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.065) 0:01:09.560 ***** 2021-01-27T16:28:58.155 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-27T16:28:58.157 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:28:58.192 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.056) 0:01:09.616 ***** 2021-01-27T16:28:58.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T16:28:58.200 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T16:28:58.237 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.044) 0:01:09.661 ***** 2021-01-27T16:28:58.244 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-27T16:28:58.246 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:58.281 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.043) 0:01:09.705 ***** 2021-01-27T16:28:58.319 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T16:28:58.321 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13965217, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129891, 'size_available': 926228033536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165093, 'block_size': 4096, 'inode_available': 60889883}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129891, "block_size": 4096, "block_total": 240095108, "block_used": 13965217, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889883, "inode_total": 61054976, "inode_used": 165093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228033536, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-27T16:28:58.357 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.075) 0:01:09.781 ***** 2021-01-27T16:28:58.373 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T16:28:58.375 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009140", "end": "2021-01-27 16:28:58.197416", "rc": 0, "start": "2021-01-27 16:28:58.188276", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:58.414 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.057) 0:01:09.838 ***** 2021-01-27T16:28:58.451 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T16:28:58.453 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:58.488 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.074) 0:01:09.913 ***** 2021-01-27T16:28:58.505 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-27T16:28:58.507 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008998", "end": "2021-01-27 16:28:58.752268", "rc": 0, "start": "2021-01-27 16:28:58.743270", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:28:58.541 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.052) 0:01:09.965 ***** 2021-01-27T16:28:58.546 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T16:28:58.583 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.042) 0:01:10.008 ***** 2021-01-27T16:28:58.589 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-27T16:28:58.591 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13965217, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129891, 'size_available': 926228033536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165093, 'block_size': 4096, 'inode_available': 60889883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129891, "block_size": 4096, "block_total": 240095108, "block_used": 13965217, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889883, "inode_total": 61054976, "inode_used": 165093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228033536, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:58.627 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.044) 0:01:10.052 ***** 2021-01-27T16:28:58.635 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T16:28:58.636 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:28:58.647 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-27T16:28:58.685 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:28:58 +0000 (0:00:00.057) 0:01:10.110 ***** 2021-01-27T16:28:58.732 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-27T16:28:58.734 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:00.337 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTI2A7Gb7BhJWc2NkvVpAgxw0oZMB5WkZP'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.583464", "end": "2021-01-27 16:29:00.154796", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTI2A7Gb7BhJWc2NkvVpAgxw0oZMB5WkZP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:28:58.571332", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:00.348 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:00.350 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:00.475 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SgHjkFCO86KFmjCy6L0Qs3vvV53D0bMxr'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.609332", "end": "2021-01-27 16:29:00.719035", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SgHjkFCO86KFmjCy6L0Qs3vvV53D0bMxr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:28:59.109703", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:00.487 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:00.499 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:01.683 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwT8UfWdrZfGl4lpwBhBSr9SWPH5vojat7F'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.207748", "end": "2021-01-27 16:29:01.494508", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwT8UfWdrZfGl4lpwBhBSr9SWPH5vojat7F"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:00.286760", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:01.695 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LJNP', 'wwn-0x5000c500918dbfac'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LJNP-part1', 'wwn-0x5000c500918dbfac-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918dbfac', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LJNP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJNP", "wwn-0x5000c500918dbfac"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJNP-part1", "wwn-0x5000c500918dbfac-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LJNP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918dbfac"}}, 2021-01-27T16:29:01.696 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T16:29:01.800 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6S2QKK5Ypui1eYlKeDiMFEkTGvBQovtWMU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.170354", "end": "2021-01-27 16:29:02.041131", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6S2QKK5Ypui1eYlKeDiMFEkTGvBQovtWMU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:00.870777", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:01.812 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1aea6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHPJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, 2021-01-27T16:29:01.814 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T16:29:02.985 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-NeEJJI-tQVw-8uNE-ay6A-NDOB-xNrf-RzGd1K', 'nvme-INTEL_SSDPED1D480GA_PHMB7513001L480DGN', 'nvme-nvme.8086-50484d42373531333030314c34383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.169113", "end": "2021-01-27 16:29:02.801592", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-NeEJJI-tQVw-8uNE-ay6A-NDOB-xNrf-RzGd1K", "nvme-INTEL_SSDPED1D480GA_PHMB7513001L480DGN", "nvme-nvme.8086-50484d42373531333030314c34383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:01.632479", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You 2021-01-27T16:29:02.988 INFO:teuthology.task.ansible.out:may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:02.997 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:03.009 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:03.116 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-JNGQe4-1lGN-dd8C-nAqL-WaUv-iGUr-NeFcx0', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.156830", "end": "2021-01-27 16:29:03.344794", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-JNGQe4-1lGN-dd8C-nAqL-WaUv-iGUr-NeFcx0", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:02.187964", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-27T16:29:03.254 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard 2021-01-27T16:29:03.256 INFO:teuthology.task.ansible.out:": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:04.335 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTqN8OYsRGrwNkQeyv7iYS9gPFxVrQkd5e'], 'uuids': ['a3deb0b8-498a-4be7-b65b-c5e6f23aed16']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.190601", "end": "2021-01-27 16:29:04.150663", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTqN8OYsRGrwNkQeyv7iYS9gPFxVrQkd5e"], "labels": [], "masters": [], "uuids": ["a3deb0b8-498a-4be7-b65b-c5e6f23aed16"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:02.960062", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:04.347 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:04.359 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:04.423 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SN4PSEOJi66EH2KBzoOx17dpvUvJqTAKm'], 'uuids': ['7dd0b6d4-2cbe-45af-8bb3-9060d43441ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.160666", "end": "2021-01-27 16:29:04.666002", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SN4PSEOJi66EH2KBzoOx17dpvUvJqTAKm"], "labels": [], "masters": [], "uuids": ["7dd0b6d4-2cbe-45af-8bb3-9060d43441ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:03.505336", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:04.435 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:04.436 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:05.641 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTQBB0juaipfvi6mhmMcBwH2NM6117N0W3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.154341", "end": "2021-01-27 16:29:05.453292", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTQBB0juaipfvi6mhmMcBwH2NM6117N0W3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:04.298951", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:05.654 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:05.738 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SFb3hyDLZnhU4AkAGk1rrwwsiCXlBXOzG'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.173993", "end": "2021-01-27 16:29:05.982053", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SFb3hyDLZnhU4AkAGk1rrwwsiCXlBXOzG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:04.808060", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:05.751 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:06.934 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTHMM3OpLO8qDTLfn3Mbc3bfhKvzeM2N7q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.159114", "end": "2021-01-27 16:29:06.748678", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTHMM3OpLO8qDTLfn3Mbc3bfhKvzeM2N7q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:05.589564", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:06.994 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:06 +0000 (0:00:08.308) 0:01:18.418 ***** 2021-01-27T16:29:07.013 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SUkToomktK5mD709G7EJwwKqigP4nMt4o'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.131891", "end": "2021-01-27 16:29:07.248976", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SUkToomktK5mD709G7EJwwKqigP4nMt4o"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:06.117085", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-27T16:29:07.061 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:07 +0000 (0:00:00.066) 0:01:18.485 ***** 2021-01-27T16:29:07.068 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T16:29:07.070 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.102 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.279 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTI2A7Gb7BhJWc2NkvVpAgxw0oZMB5WkZP'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.115420", "end": "2021-01-27 16:29:07.092095", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTI2A7Gb7BhJWc2NkvVpAgxw0oZMB5WkZP"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:06.976675", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110711 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110711 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.291 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.292 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.397 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SgHjkFCO86KFmjCy6L0Qs3vvV53D0bMxr'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.165042", "end": "2021-01-27 16:29:07.641400", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SgHjkFCO86KFmjCy6L0Qs3vvV53D0bMxr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.476358", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160658 s, 718 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160658 s, 718 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.408 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.420 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.524 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwT8UfWdrZfGl4lpwBhBSr9SWPH5vojat7F'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.112824", "end": "2021-01-27 16:29:07.342609", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwT8UfWdrZfGl4lpwBhBSr9SWPH5vojat7F"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.229785", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.108076 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.108076 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.536 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LJNP', 'wwn-0x5000c500918dbfac'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LJNP-part1', 'wwn-0x5000c500918dbfac-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918dbfac', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LJNP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJNP", "wwn-0x5000c500918dbfac"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LJNP-part1", "wwn-0x5000c500918dbfac-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LJNP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918dbfac"}}, 2021-01-27T16:29:07.538 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.703 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-NeEJJI-tQVw-8uNE-ay6A-NDOB-xNrf-RzGd1K', 'nvme-INTEL_SSDPED1D480GA_PHMB7513001L480DGN', 'nvme-nvme.8086-50484d42373531333030314c34383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055167", "end": "2021-01-27 16:29:07.522344", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-NeEJJI-tQVw-8uNE-ay6A-NDOB-xNrf-RzGd1K", "nvme-INTEL_SSDPED1D480GA_PHMB7513001L480DGN", "nvme-nvme.8086-50484d42373531333030314c34383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.467177", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0503929 s, 2.3 GB/s", "stderr_lines": [" 2021-01-27T16:29:07.704 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0503929 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.715 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6S2QKK5Ypui1eYlKeDiMFEkTGvBQovtWMU'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.176288", "end": "2021-01-27 16:29:07.960577", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6S2QKK5Ypui1eYlKeDiMFEkTGvBQovtWMU"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.784289", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.171405 s, 673 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.171405 s, 673 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.718 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.720 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1aea6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QHPJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, 2021-01-27T16:29:07.721 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.733 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.900 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-JNGQe4-1lGN-dd8C-nAqL-WaUv-iGUr-NeFcx0', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057367", "end": "2021-01-27 16:29:08.145023", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-JNGQe4-1lGN-dd8C-nAqL-WaUv-iGUr-NeFcx0", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:08.087656", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.052494 s, 2.2 GB/s", "stde 2021-01-27T16:29:07.902 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.052494 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.912 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.924 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.956 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTqN8OYsRGrwNkQeyv7iYS9gPFxVrQkd5e'], 'uuids': ['a3deb0b8-498a-4be7-b65b-c5e6f23aed16']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.115064", "end": "2021-01-27 16:29:07.775871", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTqN8OYsRGrwNkQeyv7iYS9gPFxVrQkd5e"], "labels": [], "masters": [], "uuids": ["a3deb0b8-498a-4be7-b65b-c5e6f23aed16"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.660807", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110476 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110476 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:07.967 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:07.981 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:08.210 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SN4PSEOJi66EH2KBzoOx17dpvUvJqTAKm'], 'uuids': ['7dd0b6d4-2cbe-45af-8bb3-9060d43441ab']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.163027", "end": "2021-01-27 16:29:08.451576", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SN4PSEOJi66EH2KBzoOx17dpvUvJqTAKm"], "labels": [], "masters": [], "uuids": ["7dd0b6d4-2cbe-45af-8bb3-9060d43441ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:08.288549", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159151 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159151 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.223 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:08.224 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTQBB0juaipfvi6mhmMcBwH2NM6117N0W3'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.114811", "end": "2021-01-27 16:29:08.040196", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTQBB0juaipfvi6mhmMcBwH2NM6117N0W3"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:07.925385", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110342 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110342 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.226 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:08.237 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:08.469 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTHMM3OpLO8qDTLfn3Mbc3bfhKvzeM2N7q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.113702", "end": "2021-01-27 16:29:08.282442", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-fabWLWR2scxL1NSr4yAfvyZnPQ9zznwTHMM3OpLO8qDTLfn3Mbc3bfhKvzeM2N7q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:08.168740", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109049 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109049 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.516 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:08 +0000 (0:00:01.455) 0:01:19.941 ***** 2021-01-27T16:29:08.534 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SFb3hyDLZnhU4AkAGk1rrwwsiCXlBXOzG'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.168958", "end": "2021-01-27 16:29:08.773187", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SFb3hyDLZnhU4AkAGk1rrwwsiCXlBXOzG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:08.604229", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164148 s, 703 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164148 s, 703 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.535 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:08.806 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-27T16:29:08.808 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.151312", "end": "2021-01-27 16:29:08.617733", "rc": 0, "start": "2021-01-27 16:29:08.466421", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.843 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:08 +0000 (0:00:00.326) 0:01:20.267 ***** 2021-01-27T16:29:08.849 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-27T16:29:08.851 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SUkToomktK5mD709G7EJwwKqigP4nMt4o'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.160946", "end": "2021-01-27 16:29:09.068777", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-IEwjghH5tAhvaZsQjB6hFlxku3iGdr6SUkToomktK5mD709G7EJwwKqigP4nMt4o"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-27 16:29:08.907831", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156226 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156226 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:08.897 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:08 +0000 (0:00:00.054) 0:01:20.322 ***** 2021-01-27T16:29:09.059 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T16:29:09.060 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.081977", "end": "2021-01-27 16:29:08.874475", "rc": 0, "start": "2021-01-27 16:29:08.792498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:09.096 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.198) 0:01:20.520 ***** 2021-01-27T16:29:09.123 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T16:29:09.160 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.064) 0:01:20.585 ***** 2021-01-27T16:29:09.187 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-27T16:29:09.189 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.146093", "end": "2021-01-27 16:29:09.432827", "rc": 0, "start": "2021-01-27 16:29:09.286734", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:09.227 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.066) 0:01:20.652 ***** 2021-01-27T16:29:09.261 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.034) 0:01:20.686 ***** 2021-01-27T16:29:09.267 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T16:29:09.269 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.306 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.045) 0:01:20.731 ***** 2021-01-27T16:29:09.333 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T16:29:09.334 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.371 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.064) 0:01:20.795 ***** 2021-01-27T16:29:09.397 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T16:29:09.399 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.435 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.064) 0:01:20.860 ***** 2021-01-27T16:29:09.483 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-27T16:29:09.485 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.087826", "end": "2021-01-27 16:29:09.729607", "rc": 0, "start": "2021-01-27 16:29:09.641781", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:09.521 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.085) 0:01:20.946 ***** 2021-01-27T16:29:09.547 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-27T16:29:09.589 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.067) 0:01:21.013 ***** 2021-01-27T16:29:09.594 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T16:29:09.596 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:29:09.633 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.043) 0:01:21.057 ***** 2021-01-27T16:29:09.638 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-27T16:29:09.640 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.679 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.046) 0:01:21.104 ***** 2021-01-27T16:29:09.685 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T16:29:09.686 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.723 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.044) 0:01:21.148 ***** 2021-01-27T16:29:09.729 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-27T16:29:09.731 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.767 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.043) 0:01:21.191 ***** 2021-01-27T16:29:09.773 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-27T16:29:09.774 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.810 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.043) 0:01:21.235 ***** 2021-01-27T16:29:09.817 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T16:29:09.818 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.857 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.046) 0:01:21.282 ***** 2021-01-27T16:29:09.863 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:09.864 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.901 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.043) 0:01:21.325 ***** 2021-01-27T16:29:09.907 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-27T16:29:09.909 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.944 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.043) 0:01:21.369 ***** 2021-01-27T16:29:09.950 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:09.952 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:09.989 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:09 +0000 (0:00:00.044) 0:01:21.413 ***** 2021-01-27T16:29:10.020 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T16:29:10.021 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.055 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.066) 0:01:21.480 ***** 2021-01-27T16:29:10.073 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-27T16:29:10.075 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-27T16:29:10.110 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.054) 0:01:21.535 ***** 2021-01-27T16:29:10.117 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-27T16:29:10.118 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.155 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.044) 0:01:21.580 ***** 2021-01-27T16:29:10.162 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-27T16:29:10.163 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'block_used': 13965217, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129891, 'size_available': 926228033536, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165093, 'block_size': 4096, 'inode_available': 60889883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129891, "block_size": 4096, "block_total": 240095108, "block_used": 13965217, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889883, "inode_total": 61054976, "inode_used": 165093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228033536, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.204 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.049) 0:01:21.629 ***** 2021-01-27T16:29:10.210 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T16:29:10.212 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.248 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.043) 0:01:21.672 ***** 2021-01-27T16:29:10.255 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-27T16:29:10.257 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.293 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.045) 0:01:21.718 ***** 2021-01-27T16:29:10.322 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:10.323 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.358 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.065) 0:01:21.783 ***** 2021-01-27T16:29:10.386 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:10.388 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.422 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.064) 0:01:21.847 ***** 2021-01-27T16:29:10.459 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-27T16:29:10.461 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.495 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.072) 0:01:21.919 ***** 2021-01-27T16:29:10.521 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-27T16:29:10.523 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.557 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.061) 0:01:21.981 ***** 2021-01-27T16:29:10.583 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-27T16:29:10.585 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:10.618 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:10 +0000 (0:00:00.061) 0:01:22.042 ***** 2021-01-27T16:29:11.047 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-27T16:29:11.048 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T16:29:11.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:11 +0000 (0:00:00.465) 0:01:22.508 ***** 2021-01-27T16:29:11.142 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-27T16:29:11.179 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:11 +0000 (0:00:00.095) 0:01:22.603 ***** 2021-01-27T16:29:11.765 INFO:teuthology.task.ansible.out: 2021-01-27T16:29:11.767 INFO:teuthology.task.ansible.out:TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:11.777 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.146 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.157 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.529 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.571 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.902 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:12.935 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:13.276 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:13.313 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:13 +0000 (0:00:02.134) 0:01:24.738 ***** 2021-01-27T16:29:13.330 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-27T16:29:13.370 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:13 +0000 (0:00:00.056) 0:01:24.794 ***** 2021-01-27T16:29:13.448 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-27T16:29:13.450 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T16:29:13.486 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:13 +0000 (0:00:00.116) 0:01:24.911 ***** 2021-01-27T16:29:13.503 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-27T16:29:13.540 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:13 +0000 (0:00:00.053) 0:01:24.965 ***** 2021-01-27T16:29:13.639 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-27T16:29:13.641 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.682 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.746 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.799 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.863 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.906 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.969 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:13.980 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.024 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.483) 0:01:25.448 ***** 2021-01-27T16:29:14.031 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-27T16:29:14.033 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.047 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-27T16:29:14.048 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.082 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.058) 0:01:25.507 ***** 2021-01-27T16:29:14.116 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.033) 0:01:25.540 ***** 2021-01-27T16:29:14.121 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-27T16:29:14.123 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.161 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.044) 0:01:25.585 ***** 2021-01-27T16:29:14.166 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-27T16:29:14.168 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.206 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.045) 0:01:25.630 ***** 2021-01-27T16:29:14.233 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-27T16:29:14.234 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:14.267 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.060) 0:01:25.691 ***** 2021-01-27T16:29:14.293 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T16:29:14.295 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:14.331 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.063) 0:01:25.755 ***** 2021-01-27T16:29:14.368 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T16:29:14.370 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T16:29:14.417 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.086) 0:01:25.841 ***** 2021-01-27T16:29:14.422 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-27T16:29:14.424 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:14.459 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.042) 0:01:25.884 ***** 2021-01-27T16:29:14.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-27T16:29:14.497 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-27T16:29:14.529 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.069) 0:01:25.953 ***** 2021-01-27T16:29:14.866 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-27T16:29:14.867 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true} 2021-01-27T16:29:14.903 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.374) 0:01:26.327 ***** 2021-01-27T16:29:14.919 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true} 2021-01-27T16:29:14.954 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:14 +0000 (0:00:00.050) 0:01:26.378 ***** 2021-01-27T16:29:15.373 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-27T16:29:15.375 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-27T16:29:15.408 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.454) 0:01:26.833 ***** 2021-01-27T16:29:15.444 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.035) 0:01:26.868 ***** 2021-01-27T16:29:15.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-27T16:29:15.451 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.484 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.040) 0:01:26.909 ***** 2021-01-27T16:29:15.491 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.526 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.041) 0:01:26.950 ***** 2021-01-27T16:29:15.531 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-27T16:29:15.533 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.568 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.041) 0:01:26.992 ***** 2021-01-27T16:29:15.573 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.609 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.041) 0:01:27.033 ***** 2021-01-27T16:29:15.614 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T16:29:15.616 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.651 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.042) 0:01:27.076 ***** 2021-01-27T16:29:15.657 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.693 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.041) 0:01:27.118 ***** 2021-01-27T16:29:15.698 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-27T16:29:15.700 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.734 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.040) 0:01:27.159 ***** 2021-01-27T16:29:15.741 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:15.777 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.042) 0:01:27.202 ***** 2021-01-27T16:29:15.876 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-27T16:29:15.877 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T16:29:15.913 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.135) 0:01:27.337 ***** 2021-01-27T16:29:15.929 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T16:29:15.966 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:15 +0000 (0:00:00.053) 0:01:27.390 ***** 2021-01-27T16:29:16.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-27T16:29:16.056 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:16.091 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.124) 0:01:27.515 ***** 2021-01-27T16:29:16.107 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:16.143 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.052) 0:01:27.568 ***** 2021-01-27T16:29:16.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-27T16:29:16.441 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T16:29:16.481 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.337) 0:01:27.905 ***** 2021-01-27T16:29:16.486 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-27T16:29:16.528 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.047) 0:01:27.952 ***** 2021-01-27T16:29:16.803 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-27T16:29:16.805 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T16:29:16.840 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.312) 0:01:28.265 ***** 2021-01-27T16:29:16.847 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-27T16:29:16.886 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:16 +0000 (0:00:00.045) 0:01:28.310 ***** 2021-01-27T16:29:17.494 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-27T16:29:17.496 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:29:17.532 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.645) 0:01:28.956 ***** 2021-01-27T16:29:17.537 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:29:17.575 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.043) 0:01:29.000 ***** 2021-01-27T16:29:17.789 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-27T16:29:17.791 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.129213", "end": "2021-01-27 16:29:17.609424", "rc": 0, "start": "2021-01-27 16:29:17.480211", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T16:29:17.826 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.250) 0:01:29.250 ***** 2021-01-27T16:29:17.852 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T16:29:17.854 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:17.889 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.060) 0:01:29.311 ***** 2021-01-27T16:29:17.904 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.152380", "end": "2021-01-27 16:29:18.113499", "rc": 0, "start": "2021-01-27 16:29:17.961119", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-27T16:29:17.929 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.042) 0:01:29.354 ***** 2021-01-27T16:29:17.934 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-27T16:29:17.936 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:17.971 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:17 +0000 (0:00:00.041) 0:01:29.396 ***** 2021-01-27T16:29:17.976 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-27T16:29:17.978 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:18.013 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.042) 0:01:29.438 ***** 2021-01-27T16:29:18.058 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-27T16:29:18.060 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:18.092 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.078) 0:01:29.517 ***** 2021-01-27T16:29:18.605 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T16:29:18.607 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:29:18.641 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.549) 0:01:30.066 ***** 2021-01-27T16:29:18.668 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T16:29:18.669 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:18.706 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.064) 0:01:30.130 ***** 2021-01-27T16:29:18.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-27T16:29:18.727 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:29:18.763 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.056) 0:01:30.187 ***** 2021-01-27T16:29:18.789 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-27T16:29:18.791 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:18.824 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:18 +0000 (0:00:00.060) 0:01:30.248 ***** 2021-01-27T16:29:19.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T16:29:19.017 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T16:29:19.051 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.227) 0:01:30.476 ***** 2021-01-27T16:29:19.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T16:29:19.079 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:19.112 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.060) 0:01:30.537 ***** 2021-01-27T16:29:19.139 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-27T16:29:19.140 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-27T16:29:19.175 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.063) 0:01:30.600 ***** 2021-01-27T16:29:19.201 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-27T16:29:19.203 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:19.237 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.061) 0:01:30.661 ***** 2021-01-27T16:29:19.316 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T16:29:19.317 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ActiveEnterTimestampMonotonic": "15085137", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service network.target sysinit.target system.slice -.mount systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:22 UTC", "AssertTimestampMonotonic": "14799487", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ConditionTimestampMonotonic": "14799485", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-27T16:29:19.319 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "881", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ExecMainStartTimestampMonotonic": "15085116", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:22 UTC", "InactiveExitTimestampMonotonic": "14800423", "InvocationID": "4d1eacf8a9754bcf8016a4725a21baca", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T16:29:19.320 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127780", "LimitNPROCSoft": "127780", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "881", "MemoryAccounting": "yes", "MemoryCurrent": "3883008", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-01-27T16:29:19.323 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:22 UTC", "StateChangeTimestampMonotonic": "15085137", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:29:19.354 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.116) 0:01:30.778 ***** 2021-01-27T16:29:19.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:19.382 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T16:29:19.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.065) 0:01:30.843 ***** 2021-01-27T16:29:19.435 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-27T16:29:19.437 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ActiveEnterTimestampMonotonic": "14952420", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount sysinit.target basic.target system.slice network.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-01-27 16:27:22 UTC", "AssertTimestampMonotonic": "14711622", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ConditionTimestampMonotonic": "14711620", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-01-27T16:29:19.438 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "884", "ExecMainStartTimestamp": "Wed 2021-01-27 16:27:22 UTC", "ExecMainStartTimestampMonotonic": "14952400", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-01-27 16:27:22 UTC", "InactiveExitTimestampMonotonic": "14712951", "InvocationID": "195a5abfa9a9486f9809cf51e7be02f3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-27T16:29:19.440 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "884", "MemoryAccounting": "yes", "MemoryCurrent": "3710976", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-01-27T16:29:19.442 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:27:22 UTC", "StateChangeTimestampMonotonic": "14952420", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:29:19.474 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.054) 0:01:30.898 ***** 2021-01-27T16:29:19.480 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:19.481 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T16:29:19.515 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.041) 0:01:30.940 ***** 2021-01-27T16:29:19.523 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:19.524 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-27T16:29:19.558 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.043) 0:01:30.983 ***** 2021-01-27T16:29:19.564 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T16:29:19.566 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:19.601 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.042) 0:01:31.026 ***** 2021-01-27T16:29:19.607 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:19.608 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-27T16:29:19.645 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.042) 0:01:31.069 ***** 2021-01-27T16:29:19.670 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-27T16:29:19.672 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:19.709 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:19 +0000 (0:00:00.064) 0:01:31.133 ***** 2021-01-27T16:29:20.863 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-27T16:29:20.865 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:29:20.899 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:20 +0000 (0:00:01.190) 0:01:32.324 ***** 2021-01-27T16:29:20.926 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T16:29:20.927 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:20.963 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:20 +0000 (0:00:00.064) 0:01:32.388 ***** 2021-01-27T16:29:20.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-27T16:29:20.982 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:29:21.017 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.054) 0:01:32.442 ***** 2021-01-27T16:29:21.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-27T16:29:21.045 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:21.084 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.066) 0:01:32.508 ***** 2021-01-27T16:29:21.142 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-27T16:29:21.144 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T16:29:21.179 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.095) 0:01:32.604 ***** 2021-01-27T16:29:21.269 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-27T16:29:21.307 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.127) 0:01:32.732 ***** 2021-01-27T16:29:21.605 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-27T16:29:21.607 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T16:29:21.642 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.334) 0:01:33.067 ***** 2021-01-27T16:29:21.753 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-27T16:29:21.789 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:21 +0000 (0:00:00.146) 0:01:33.213 ***** 2021-01-27T16:29:24.429 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-27T16:29:24.431 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T16:29:24.465 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:24 +0000 (0:00:02.675) 0:01:35.889 ***** 2021-01-27T16:29:24.533 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-27T16:29:24.570 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:24 +0000 (0:00:00.105) 0:01:35.994 ***** 2021-01-27T16:29:24.980 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T16:29:24.982 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false} 2021-01-27T16:29:25.016 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.446) 0:01:36.441 ***** 2021-01-27T16:29:25.043 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-27T16:29:25.045 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T16:29:25.078 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.061) 0:01:36.503 ***** 2021-01-27T16:29:25.084 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-27T16:29:25.086 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false} 2021-01-27T16:29:25.122 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.043) 0:01:36.546 ***** 2021-01-27T16:29:25.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-27T16:29:25.150 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-27T16:29:25.183 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.061) 0:01:36.607 ***** 2021-01-27T16:29:25.272 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-27T16:29:25.274 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611764602.6163337, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611764601.3083336, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611764601.3083336, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T16:29:25.309 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.125) 0:01:36.733 ***** 2021-01-27T16:29:25.367 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611764605.9577718, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611764604.6537719, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611764604.6537719, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-27T16:29:25.403 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.094) 0:01:36.828 ***** 2021-01-27T16:29:25.730 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-27T16:29:25.732 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T16:29:25.765 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.362) 0:01:37.190 ***** 2021-01-27T16:29:25.772 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-27T16:29:25.813 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.047) 0:01:37.237 ***** 2021-01-27T16:29:25.819 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-27T16:29:25.821 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T16:29:25.856 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.042) 0:01:37.280 ***** 2021-01-27T16:29:25.864 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-27T16:29:25.899 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.043) 0:01:37.324 ***** 2021-01-27T16:29:25.905 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-27T16:29:25.906 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:25.942 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.043) 0:01:37.367 ***** 2021-01-27T16:29:25.948 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:25.986 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:25 +0000 (0:00:00.043) 0:01:37.410 ***** 2021-01-27T16:29:26.120 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T16:29:26.157 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.170) 0:01:37.581 ***** 2021-01-27T16:29:26.164 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-27T16:29:26.201 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.044) 0:01:37.625 ***** 2021-01-27T16:29:26.321 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-27T16:29:26.323 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T16:29:26.357 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.156) 0:01:37.782 ***** 2021-01-27T16:29:26.373 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-27T16:29:26.408 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.051) 0:01:37.833 ***** 2021-01-27T16:29:26.414 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-27T16:29:26.416 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.451 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.042) 0:01:37.875 ***** 2021-01-27T16:29:26.457 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.495 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.043) 0:01:37.919 ***** 2021-01-27T16:29:26.501 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-27T16:29:26.503 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.514 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.516 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.554 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.059) 0:01:37.978 ***** 2021-01-27T16:29:26.560 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.561 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.561 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.562 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.562 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.600 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.046) 0:01:38.025 ***** 2021-01-27T16:29:26.607 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-27T16:29:26.610 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.620 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.624 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.626 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi094.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.662 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.061) 0:01:38.086 ***** 2021-01-27T16:29:26.668 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.668 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.670 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.670 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.682 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.719 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.057) 0:01:38.144 ***** 2021-01-27T16:29:26.752 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.033) 0:01:38.177 ***** 2021-01-27T16:29:26.758 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T16:29:26.759 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.794 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.041) 0:01:38.219 ***** 2021-01-27T16:29:26.800 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-27T16:29:26.802 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.839 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.044) 0:01:38.263 ***** 2021-01-27T16:29:26.845 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T16:29:26.846 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.884 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.044) 0:01:38.308 ***** 2021-01-27T16:29:26.890 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-27T16:29:26.891 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.926 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.042) 0:01:38.351 ***** 2021-01-27T16:29:26.934 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T16:29:26.936 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:26.971 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:26 +0000 (0:00:00.044) 0:01:38.396 ***** 2021-01-27T16:29:26.978 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-27T16:29:26.979 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.017 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.045) 0:01:38.441 ***** 2021-01-27T16:29:27.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T16:29:27.026 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.063 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.046) 0:01:38.488 ***** 2021-01-27T16:29:27.069 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-27T16:29:27.071 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.107 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.043) 0:01:38.531 ***** 2021-01-27T16:29:27.113 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T16:29:27.114 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.155 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.048) 0:01:38.580 ***** 2021-01-27T16:29:27.162 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-27T16:29:27.163 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.308 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.152) 0:01:38.732 ***** 2021-01-27T16:29:27.324 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T16:29:27.326 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.362 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.054) 0:01:38.787 ***** 2021-01-27T16:29:27.368 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T16:29:27.370 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.407 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.044) 0:01:38.831 ***** 2021-01-27T16:29:27.412 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T16:29:27.414 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.449 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.042) 0:01:38.874 ***** 2021-01-27T16:29:27.455 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-27T16:29:27.457 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.495 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.045) 0:01:38.919 ***** 2021-01-27T16:29:27.521 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-27T16:29:27.523 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:27.558 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:27 +0000 (0:00:00.063) 0:01:38.983 ***** 2021-01-27T16:29:27.646 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T16:29:27.648 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011063", "end": "2021-01-27 16:29:27.455024", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 16:29:27.443961", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:27.771 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010956", "end": "2021-01-27 16:29:28.012114", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-27 16:29:28.001158", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:27.813 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.015550", "end": "2021-01-27 16:29:27.626351", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 16:29:27.610801", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:27.948 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.012902", "end": "2021-01-27 16:29:28.190312", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-27 16:29:28.177410", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:27.969 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005459", "end": "2021-01-27 16:29:27.785393", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 16:29:27.779934", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:28.114 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005386", "end": "2021-01-27 16:29:28.358960", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-27 16:29:28.353574", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:28.135 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.014009", "end": "2021-01-27 16:29:27.949012", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 16:29:27.935003", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:28.174 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.615) 0:01:39.598 ***** 2021-01-27T16:29:28.201 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T16:29:28.236 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.062) 0:01:39.661 ***** 2021-01-27T16:29:28.318 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-27T16:29:28.320 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.037656", "end": "2021-01-27 16:29:28.559658", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-27 16:29:28.522002", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:28.357 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.120) 0:01:39.782 ***** 2021-01-27T16:29:28.384 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-27T16:29:28.419 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.062) 0:01:39.844 ***** 2021-01-27T16:29:28.425 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-27T16:29:28.427 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T16:29:28.596 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-27T16:29:28.699 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-27T16:29:28.732 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.312) 0:01:40.156 ***** 2021-01-27T16:29:28.769 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:28 +0000 (0:00:00.037) 0:01:40.194 ***** 2021-01-27T16:29:29.760 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi094.front.sepia.ceph.com] 2021-01-27T16:29:29.809 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-01-27T16:29:29.849 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:29 +0000 (0:00:01.080) 0:01:41.274 ***** 2021-01-27T16:29:29.889 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T16:29:29.924 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:29 +0000 (0:00:00.074) 0:01:41.349 ***** 2021-01-27T16:29:29.959 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:29 +0000 (0:00:00.034) 0:01:41.384 ***** 2021-01-27T16:29:29.965 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:29.967 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:30.003 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.044) 0:01:41.428 ***** 2021-01-27T16:29:30.008 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:30.010 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-27T16:29:30.047 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.043) 0:01:41.472 ***** 2021-01-27T16:29:30.055 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-27T16:29:30.057 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T16:29:30.094 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.047) 0:01:41.519 ***** 2021-01-27T16:29:30.099 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:30.101 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:30.139 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.044) 0:01:41.563 ***** 2021-01-27T16:29:30.176 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-27T16:29:30.178 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-27T16:29:30.214 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.075) 0:01:41.638 ***** 2021-01-27T16:29:30.850 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T16:29:30.852 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"cache_update_time": 1611764680, "cache_updated": false, "changed": false} 2021-01-27T16:29:30.893 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.678) 0:01:42.317 ***** 2021-01-27T16:29:30.921 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:30.923 INFO:teuthology.task.ansible.out:skipping: [smithi094.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:30.959 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:30 +0000 (0:00:00.066) 0:01:42.383 ***** 2021-01-27T16:29:30.965 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-27T16:29:30.966 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1611764620, "cache_updated": false, "changed": false} 2021-01-27T16:29:31.004 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.044) 0:01:42.428 ***** 2021-01-27T16:29:31.009 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:31.011 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T16:29:31.049 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.045) 0:01:42.473 ***** 2021-01-27T16:29:31.057 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:31.059 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-27T16:29:31.098 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.049) 0:01:42.523 ***** 2021-01-27T16:29:31.135 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-27T16:29:31.137 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-27T16:29:31.173 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.074) 0:01:42.597 ***** 2021-01-27T16:29:31.262 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-27T16:29:31.264 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:31.389 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:31.431 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:31.476 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.303) 0:01:42.901 ***** 2021-01-27T16:29:31.556 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-27T16:29:31.598 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:31 +0000 (0:00:00.121) 0:01:43.022 ***** 2021-01-27T16:29:31.947 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-27T16:29:31.949 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764971.5167773-169428188569391/source", "state": "file", "uid": 0} 2021-01-27T16:29:32.063 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764971.6418138-10925340842243/source", "state": "file", "uid": 0} 2021-01-27T16:29:32.354 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764971.9531534-116326495608608/source", "state": "file", "uid": 0} 2021-01-27T16:29:32.402 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:32 +0000 (0:00:00.804) 0:01:43.827 ***** 2021-01-27T16:29:32.471 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764972.0749354-136229280012497/source", "state": "file", "uid": 0} 2021-01-27T16:29:32.514 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:32 +0000 (0:00:00.112) 0:01:43.939 ***** 2021-01-27T16:29:37.298 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-27T16:29:37.300 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ecsxumg3\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ecsxumg3"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ecsxumg3\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=32da6ff0c8b13766d11f4748167f627e142aa568f523ecbb49ff479a30f68148\n Stored in directory: /tmp/pip-ephem-wheel-cache-z7ek44xy/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8a52503301b47560b8b01e648ca8fc50bd67f97103bcc04517ced38ffdf28f8d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T16:29:37.301 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ecsxumg3", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=32da6ff0c8b13766d11f4748167f627e142aa568f523ecbb49ff479a30f68148", " Stored in directory: /tmp/pip-ephem-wheel-cache-z7ek44xy/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8a52503301b47560b8b01e648ca8fc50bd67f97103bcc04517ced38ffdf28f8d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T16:29:37.337 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:37 +0000 (0:00:04.822) 0:01:48.761 ***** 2021-01-27T16:29:37.367 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-lcryhbp1\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-lcryhbp1"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-lcryhbp1\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=a3a891b42eea38be47bac31afb2fd6e7735fc937d9b7c73d1f3dbf8620259dac\n Stored in directory: /tmp/pip-ephem-wheel-cache-1_98_19j/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8a52503301b47560b8b01e648ca8fc50bd67f97103bcc04517ced38ffdf28f8d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-27T16:29:37.368 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-lcryhbp1", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=a3a891b42eea38be47bac31afb2fd6e7735fc937d9b7c73d1f3dbf8620259dac", " Stored in directory: /tmp/pip-ephem-wheel-cache-1_98_19j/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8a52503301b47560b8b01e648ca8fc50bd67f97103bcc04517ced38ffdf28f8d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-27T16:29:37.406 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:37 +0000 (0:00:00.069) 0:01:48.831 ***** 2021-01-27T16:29:37.517 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-27T16:29:37.519 INFO:teuthology.task.ansible.out:ok: [smithi094.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T16:29:37.557 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:37 +0000 (0:00:00.150) 0:01:48.981 ***** 2021-01-27T16:29:37.584 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-27T16:29:37.623 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:37 +0000 (0:00:00.065) 0:01:49.047 ***** 2021-01-27T16:29:37.981 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-27T16:29:37.983 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764977.5897567-2314035896086/source", "state": "file", "uid": 0} 2021-01-27T16:29:38.019 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:38 +0000 (0:00:00.395) 0:01:49.443 ***** 2021-01-27T16:29:38.057 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611764977.657751-144146861299675/source", "state": "file", "uid": 0} 2021-01-27T16:29:38.095 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:38 +0000 (0:00:00.076) 0:01:49.519 ***** 2021-01-27T16:29:38.247 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-27T16:29:38.249 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.035901", "end": "2021-01-27 16:29:38.061327", "rc": 0, "start": "2021-01-27 16:29:38.025426", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:38.288 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:38 +0000 (0:00:00.192) 0:01:49.712 ***** 2021-01-27T16:29:38.327 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.036951", "end": "2021-01-27 16:29:38.572294", "rc": 0, "start": "2021-01-27 16:29:38.535343", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-27T16:29:38.369 INFO:teuthology.task.ansible.out:Wednesday 27 January 2021 16:29:38 +0000 (0:00:00.081) 0:01:49.794 ***** 2021-01-27T16:29:41.585 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-27T16:29:41.586 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target sysinit.target containerd.service system.slice network-online.target systemd-journald.socket docker.socket firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T16:29:41.588 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T16:29:41.589 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T16:29:41.591 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:28:32 UTC", "StateChangeTimestampMonotonic": "85252409", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:29:42.034 INFO:teuthology.task.ansible.out:changed: [smithi094.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "containerd.service system.slice network-online.target systemd-journald.socket basic.target docker.socket sysinit.target firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-27T16:29:42.036 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-27T16:29:42.038 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127780", "LimitSIGPENDINGSoft": "127780", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-27T16:29:42.040 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-01-27 16:28:32 UTC", "StateChangeTimestampMonotonic": "84944754", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-27T16:29:42.135 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-27T16:29:42.139 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-27T16:29:42.142 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* 2021-01-27T16:29:42.144 INFO:teuthology.task.ansible.out:smithi094.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi106.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Wednesday 27 January 2021 16:29:42 +0000 (0:00:03.773) 0:01:53.567 ***** =============================================================================== testnode : Ensure packages are not present. ---------------------------- 12.35s testnode : Install packages --------------------------------------------- 9.47s testnode : Zap all non-root disks --------------------------------------- 8.31s container-host : Install registries-conf-ctl ---------------------------- 4.82s container-host : Restart docker service --------------------------------- 3.77s common : Update apt cache ----------------------------------------------- 3.04s testnode : Install packages via pip ------------------------------------- 2.68s Gathering Facts --------------------------------------------------------- 2.39s testnode : Create logical volume(s) ------------------------------------- 2.13s testnode : Update apt cache. -------------------------------------------- 2.10s testnode : Install apt keys --------------------------------------------- 2.05s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.46s testnode : Install python-pip on apt based systems. --------------------- 1.19s Gathering Facts --------------------------------------------------------- 1.08s Gathering Facts --------------------------------------------------------- 0.93s users : Create all admin users with sudo access. ------------------------ 0.82s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.80s testnode : Set the system's hostname ------------------------------------ 0.77s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.72s common : Upload megacli and cli64 for ra 2021-01-27T16:29:42.145 INFO:teuthology.task.ansible.out:id monitoring and smart.pl to /usr/sbin/. --- 0.68s 2021-01-27T16:29:42.460 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com')] 2021-01-27T16:29:42.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:29:42.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:29:42.511 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-01-27T16:29:42.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-27T16:29:42.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-27T16:29:42.716 DEBUG:teuthology.orchestra.run.smithi094:> true 2021-01-27T16:29:42.867 INFO:teuthology.run_tasks:Running task clock... 2021-01-27T16:29:42.882 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-27T16:29:42.883 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T16:29:42.883 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T16:29:42.919 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T16:29:42.920 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Command line: ntpd -gq 2021-01-27T16:29:42.920 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: proto: precision = 0.165 usec (-22) 2021-01-27T16:29:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T16:29:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T16:29:42.923 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T16:29:42.923 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T16:29:42.923 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T16:29:42.923 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T16:29:42.923 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T16:29:42.924 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2021-01-27T16:29:42.924 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen normally on 4 lo [::1]:123 2021-01-27T16:29:42.924 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2021-01-27T16:29:42.924 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:43 ntpd[5463]: Listening on routing socket on fd #22 for interface updates 2021-01-27T16:29:45.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:46 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:47.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:47.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:47.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:47.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:47.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:48 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:49.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:49.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:49.927 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:49.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:49.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:49.928 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:50 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:51.921 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.922 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.923 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:51.924 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:51.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:51.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:51.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:51.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:52 ntpd[5463]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:51.925 INFO:teuthology.orchestra.run.smithi106.stderr:27 Jan 16:29:51 ntpd[5463]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T16:29:51.926 INFO:teuthology.orchestra.run.smithi106.stdout:27 Jan 16:29:51 ntpd[5463]: ntpd: time set -0.272333 s 2021-01-27T16:29:51.926 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time set -0.272333s 2021-01-27T16:29:52.002 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T16:29:52.003 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2021-01-27T16:29:52.003 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:52.003 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:52.003 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:52.003 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:52.004 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-27T16:29:52.005 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-27T16:29:52.037 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-27T16:29:52.038 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Command line: ntpd -gq 2021-01-27T16:29:52.039 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: proto: precision = 0.149 usec (-23) 2021-01-27T16:29:52.039 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T16:29:52.040 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: restrict ::: KOD does nothing without LIMITED. 2021-01-27T16:29:52.040 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen and drop on 0 v6wildcard [::]:123 2021-01-27T16:29:52.040 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-27T16:29:52.040 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen normally on 2 lo 127.0.0.1:123 2021-01-27T16:29:52.041 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2021-01-27T16:29:52.041 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen normally on 4 lo [::1]:123 2021-01-27T16:29:52.041 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2021-01-27T16:29:52.041 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:51 ntpd[5418]: Listening on routing socket on fd #22 for interface updates 2021-01-27T16:29:52.042 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-27T16:29:52.042 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-27T16:29:53.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:53.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:53.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:53.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:53.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:53.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:53.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:53.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:53.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:53.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:53.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:53.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:52 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:55.038 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:55.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:55.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:55.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:55.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:55.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:55.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:55.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:55.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:55.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:55.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:55.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:54 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:56.038 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:56.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:55 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:57.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:57.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:57.043 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:56 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:58.038 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:58.809 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:58.809 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:58.809 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:58.810 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:58.810 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:57 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:59.039 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:59.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:59.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:59.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:59.040 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:59.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-27T16:29:59.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: can't open /var/log/ntpstats/rawstats.20210127: Permission denied 2021-01-27T16:29:59.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-27T16:29:59.041 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:58 ntpd[5418]: can't open /var/log/ntpstats/peerstats.20210127: Permission denied 2021-01-27T16:29:59.042 INFO:teuthology.orchestra.run.smithi094.stderr:27 Jan 16:29:59 ntpd[5418]: can't open /var/log/ntpstats/loopstats.20210127: Permission denied 2021-01-27T16:29:59.042 INFO:teuthology.orchestra.run.smithi094.stdout:27 Jan 16:29:59 ntpd[5418]: ntpd: time set +0.157684 s 2021-01-27T16:29:59.042 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time set +0.157684s 2021-01-27T16:29:59.092 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2021-01-27T16:29:59.093 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2021-01-27T16:29:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:59.093 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:59.094 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-27T16:29:59.095 INFO:teuthology.run_tasks:Running task install... 2021-01-27T16:29:59.108 DEBUG:teuthology.task.install:project ceph 2021-01-27T16:29:59.109 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '9f8421bb8d39043f85c071a52714801b60d36be5'}, 'extra_packages': ['cephadm']} 2021-01-27T16:29:59.109 DEBUG:teuthology.task.install:config {'sha1': '9f8421bb8d39043f85c071a52714801b60d36be5'} 2021-01-27T16:29:59.109 INFO:teuthology.task.install:Using flavor: basic 2021-01-27T16:29:59.117 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-27T16:29:59.118 INFO:teuthology.task.install:extra packages: [] 2021-01-27T16:29:59.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-01-27T16:29:59.172 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-01-27T16:29:59.177 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:29:59.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo lsb_release -is 2021-01-27T16:29:59.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2021-01-27T16:29:59.227 INFO:teuthology.orchestra.run.smithi094.stdout:Ubuntu 2021-01-27T16:29:59.233 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:29:59.233 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2021-01-27T16:29:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T16:29:59.328 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T16:29:59.329 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T16:29:59.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-01-27T16:29:59.332 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-27T16:29:59.375 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-01-27T16:29:59.381 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:29:59.381 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T16:29:59.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:29:59.390 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-27T16:29:59.391 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2021-01-27T16:29:59.392 DEBUG:teuthology.orchestra.run.smithi094:> sudo lsb_release -is 2021-01-27T16:29:59.438 INFO:teuthology.orchestra.run.smithi094.stdout:Ubuntu 2021-01-27T16:29:59.443 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:29:59.444 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-27T16:29:59.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:29:59.552 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default/ 2021-01-27T16:29:59.553 INFO:teuthology.task.install.deb:Package version is 17.0.0-142-g9f8421bb-1focal 2021-01-27T16:29:59.604 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default/ 2021-01-27T16:29:59.604 INFO:teuthology.task.install.deb:Package version is 17.0.0-142-g9f8421bb-1focal 2021-01-27T16:29:59.707 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:29:59.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T16:29:59.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2021-01-27T16:29:59.845 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:29:59.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-27T16:29:59.863 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2021-01-27T16:29:59.991 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T16:29:59.991 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:30:00.060 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T16:30:00.144 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T16:30:00.211 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-27T16:30:00.211 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-27T16:30:00.246 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal InRelease 2021-01-27T16:30:00.286 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-27T16:30:00.300 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal InRelease 2021-01-27T16:30:00.307 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T16:30:00.355 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-27T16:30:00.365 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T16:30:00.367 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-27T16:30:00.394 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal Release.gpg 2021-01-27T16:30:00.396 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main i386 Packages [3,094 B] 2021-01-27T16:30:00.440 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 Packages [16.5 kB] 2021-01-27T16:30:00.476 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 Packages [16.5 kB] 2021-01-27T16:30:00.525 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main i386 Packages [3,094 B] 2021-01-27T16:30:00.656 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 27.3 kB in 1s (35.5 kB/s) 2021-01-27T16:30:00.848 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 27.3 kB in 1s (35.3 kB/s) 2021-01-27T16:30:01.371 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:30:01.391 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-142-g9f8421bb-1focal cephadm=17.0.0-142-g9f8421bb-1focal ceph-mds=17.0.0-142-g9f8421bb-1focal ceph-mgr=17.0.0-142-g9f8421bb-1focal ceph-common=17.0.0-142-g9f8421bb-1focal ceph-fuse=17.0.0-142-g9f8421bb-1focal ceph-test=17.0.0-142-g9f8421bb-1focal radosgw=17.0.0-142-g9f8421bb-1focal python3-rados=17.0.0-142-g9f8421bb-1focal python3-rgw=17.0.0-142-g9f8421bb-1focal python3-cephfs=17.0.0-142-g9f8421bb-1focal python3-rbd=17.0.0-142-g9f8421bb-1focal libcephfs2=17.0.0-142-g9f8421bb-1focal libcephfs-dev=17.0.0-142-g9f8421bb-1focal librados2=17.0.0-142-g9f8421bb-1focal librbd1=17.0.0-142-g9f8421bb-1focal rbd-fuse=17.0.0-142-g9f8421bb-1focal 2021-01-27T16:30:01.461 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2021-01-27T16:30:01.566 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:30:01.585 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-142-g9f8421bb-1focal cephadm=17.0.0-142-g9f8421bb-1focal ceph-mds=17.0.0-142-g9f8421bb-1focal ceph-mgr=17.0.0-142-g9f8421bb-1focal ceph-common=17.0.0-142-g9f8421bb-1focal ceph-fuse=17.0.0-142-g9f8421bb-1focal ceph-test=17.0.0-142-g9f8421bb-1focal radosgw=17.0.0-142-g9f8421bb-1focal python3-rados=17.0.0-142-g9f8421bb-1focal python3-rgw=17.0.0-142-g9f8421bb-1focal python3-cephfs=17.0.0-142-g9f8421bb-1focal python3-rbd=17.0.0-142-g9f8421bb-1focal libcephfs2=17.0.0-142-g9f8421bb-1focal libcephfs-dev=17.0.0-142-g9f8421bb-1focal librados2=17.0.0-142-g9f8421bb-1focal librbd1=17.0.0-142-g9f8421bb-1focal rbd-fuse=17.0.0-142-g9f8421bb-1focal 2021-01-27T16:30:01.613 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2021-01-27T16:30:01.614 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2021-01-27T16:30:01.648 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2021-01-27T16:30:01.742 INFO:teuthology.orchestra.run.smithi106.stdout:The following package was automatically installed and is no longer required: 2021-01-27T16:30:01.743 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.71.0 2021-01-27T16:30:01.744 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T16:30:01.744 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2021-01-27T16:30:01.744 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T16:30:01.744 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T16:30:01.745 INFO:teuthology.orchestra.run.smithi106.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T16:30:01.745 INFO:teuthology.orchestra.run.smithi106.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T16:30:01.745 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T16:30:01.745 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T16:30:01.745 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T16:30:01.746 INFO:teuthology.orchestra.run.smithi106.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T16:30:01.746 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T16:30:01.746 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T16:30:01.746 INFO:teuthology.orchestra.run.smithi106.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T16:30:01.747 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T16:30:01.747 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T16:30:01.747 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T16:30:01.747 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T16:30:01.748 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T16:30:01.748 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T16:30:01.748 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T16:30:01.748 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2021-01-27T16:30:01.749 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T16:30:01.749 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T16:30:01.749 INFO:teuthology.orchestra.run.smithi106.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T16:30:01.749 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T16:30:01.750 INFO:teuthology.orchestra.run.smithi106.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T16:30:01.750 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T16:30:01.750 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T16:30:01.751 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2021-01-27T16:30:01.751 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2021-01-27T16:30:01.803 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2021-01-27T16:30:01.804 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2021-01-27T16:30:01.835 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2021-01-27T16:30:01.835 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T16:30:01.836 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T16:30:01.836 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T16:30:01.836 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T16:30:01.836 INFO:teuthology.orchestra.run.smithi106.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T16:30:01.837 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T16:30:01.838 INFO:teuthology.orchestra.run.smithi106.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T16:30:01.838 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T16:30:01.838 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T16:30:01.838 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T16:30:01.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T16:30:01.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T16:30:01.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T16:30:01.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T16:30:01.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T16:30:01.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T16:30:01.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T16:30:01.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T16:30:01.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T16:30:01.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T16:30:01.841 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse socat xmlstarlet 2021-01-27T16:30:01.841 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2021-01-27T16:30:01.842 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librbd1 2021-01-27T16:30:01.938 INFO:teuthology.orchestra.run.smithi094.stdout:The following package was automatically installed and is no longer required: 2021-01-27T16:30:01.941 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.71.0 2021-01-27T16:30:01.941 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-27T16:30:01.942 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2021-01-27T16:30:01.942 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-27T16:30:01.942 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-27T16:30:01.942 INFO:teuthology.orchestra.run.smithi094.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-27T16:30:01.943 INFO:teuthology.orchestra.run.smithi094.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-27T16:30:01.943 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-27T16:30:01.943 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-27T16:30:01.943 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-27T16:30:01.944 INFO:teuthology.orchestra.run.smithi094.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-27T16:30:01.944 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-27T16:30:01.944 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-27T16:30:01.944 INFO:teuthology.orchestra.run.smithi094.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-27T16:30:01.945 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T16:30:01.945 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-27T16:30:01.945 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-27T16:30:01.945 INFO:teuthology.orchestra.run.smithi094.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-27T16:30:01.946 INFO:teuthology.orchestra.run.smithi094.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-27T16:30:01.946 INFO:teuthology.orchestra.run.smithi094.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-27T16:30:01.946 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-27T16:30:01.946 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2021-01-27T16:30:01.946 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-27T16:30:01.947 INFO:teuthology.orchestra.run.smithi094.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-27T16:30:01.947 INFO:teuthology.orchestra.run.smithi094.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-27T16:30:01.947 INFO:teuthology.orchestra.run.smithi094.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-27T16:30:01.947 INFO:teuthology.orchestra.run.smithi094.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-27T16:30:01.948 INFO:teuthology.orchestra.run.smithi094.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-27T16:30:01.948 INFO:teuthology.orchestra.run.smithi094.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-27T16:30:01.948 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2021-01-27T16:30:01.948 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2021-01-27T16:30:02.032 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2021-01-27T16:30:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-27T16:30:02.032 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-27T16:30:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-27T16:30:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-27T16:30:02.033 INFO:teuthology.orchestra.run.smithi094.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-27T16:30:02.034 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-27T16:30:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-27T16:30:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-27T16:30:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-27T16:30:02.035 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-27T16:30:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-27T16:30:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-27T16:30:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-27T16:30:02.036 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-27T16:30:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-27T16:30:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-27T16:30:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-27T16:30:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-27T16:30:02.037 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-27T16:30:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-27T16:30:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse socat xmlstarlet 2021-01-27T16:30:02.038 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2021-01-27T16:30:02.038 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 librbd1 2021-01-27T16:30:02.158 INFO:teuthology.orchestra.run.smithi106.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T16:30:02.158 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 169 MB of archives. 2021-01-27T16:30:02.159 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T16:30:02.159 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-142-g9f8421bb-1focal [3,720 B] 2021-01-27T16:30:02.302 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-142-g9f8421bb-1focal [3,291 kB] 2021-01-27T16:30:02.347 INFO:teuthology.orchestra.run.smithi094.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-27T16:30:02.348 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 169 MB of archives. 2021-01-27T16:30:02.348 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-27T16:30:02.348 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-142-g9f8421bb-1focal [3,720 B] 2021-01-27T16:30:02.452 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T16:30:02.486 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-142-g9f8421bb-1focal [3,291 kB] 2021-01-27T16:30:02.801 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-142-g9f8421bb-1focal [3,344 kB] 2021-01-27T16:30:02.813 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T16:30:02.814 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T16:30:02.819 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T16:30:02.947 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T16:30:02.957 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-142-g9f8421bb-1focal [3,344 kB] 2021-01-27T16:30:02.991 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T16:30:02.998 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T16:30:03.004 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T16:30:03.009 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T16:30:03.034 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T16:30:03.037 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T16:30:03.039 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T16:30:03.047 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T16:30:03.052 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T16:30:03.130 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T16:30:03.135 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T16:30:03.136 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T16:30:03.140 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T16:30:03.145 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T16:30:03.145 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T16:30:03.170 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T16:30:03.171 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T16:30:03.172 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T16:30:03.213 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T16:30:03.254 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T16:30:03.262 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T16:30:03.265 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T16:30:03.265 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T16:30:03.269 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T16:30:03.272 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T16:30:03.275 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T16:30:03.275 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T16:30:03.293 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T16:30:03.301 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-142-g9f8421bb-1focal [705 kB] 2021-01-27T16:30:03.318 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-142-g9f8421bb-1focal [408 kB] 2021-01-27T16:30:03.343 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-142-g9f8421bb-1focal [21.7 kB] 2021-01-27T16:30:03.343 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-142-g9f8421bb-1focal [197 kB] 2021-01-27T16:30:03.347 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-27T16:30:03.351 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-142-g9f8421bb-1focal [29.4 kB] 2021-01-27T16:30:03.352 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-142-g9f8421bb-1focal [386 kB] 2021-01-27T16:30:03.356 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-142-g9f8421bb-1focal [3,501 kB] 2021-01-27T16:30:03.380 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-142-g9f8421bb-1focal [705 kB] 2021-01-27T16:30:03.431 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-142-g9f8421bb-1focal [408 kB] 2021-01-27T16:30:03.435 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-142-g9f8421bb-1focal [21.7 kB] 2021-01-27T16:30:03.436 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-142-g9f8421bb-1focal [197 kB] 2021-01-27T16:30:03.439 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-142-g9f8421bb-1focal [29.4 kB] 2021-01-27T16:30:03.439 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-142-g9f8421bb-1focal [386 kB] 2021-01-27T16:30:03.574 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-142-g9f8421bb-1focal [116 kB] 2021-01-27T16:30:03.576 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-142-g9f8421bb-1focal [446 kB] 2021-01-27T16:30:03.576 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-142-g9f8421bb-1focal [3,501 kB] 2021-01-27T16:30:03.583 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-142-g9f8421bb-1focal [22.0 MB] 2021-01-27T16:30:03.606 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T16:30:03.681 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T16:30:03.683 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T16:30:03.697 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-27T16:30:03.698 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-27T16:30:03.703 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-27T16:30:03.739 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T16:30:03.739 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T16:30:03.740 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T16:30:03.741 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T16:30:03.742 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T16:30:03.743 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T16:30:03.744 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T16:30:03.767 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T16:30:03.772 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T16:30:03.847 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T16:30:03.848 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T16:30:03.848 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-142-g9f8421bb-1focal [116 kB] 2021-01-27T16:30:03.851 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-142-g9f8421bb-1focal [446 kB] 2021-01-27T16:30:03.851 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T16:30:03.853 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-27T16:30:03.855 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T16:30:03.856 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T16:30:03.861 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T16:30:03.863 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T16:30:03.866 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T16:30:03.879 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-27T16:30:03.886 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-27T16:30:03.894 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-27T16:30:03.899 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-27T16:30:03.922 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-142-g9f8421bb-1focal [22.0 MB] 2021-01-27T16:30:03.923 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-27T16:30:03.926 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-27T16:30:03.927 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T16:30:03.927 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T16:30:03.928 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-27T16:30:03.934 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-27T16:30:03.935 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-27T16:30:04.006 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T16:30:04.008 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T16:30:04.012 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-27T16:30:04.017 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-27T16:30:04.019 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-27T16:30:04.023 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-27T16:30:04.027 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-27T16:30:04.028 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T16:30:04.028 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T16:30:04.029 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-27T16:30:04.029 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T16:30:04.029 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T16:30:04.030 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T16:30:04.030 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T16:30:04.053 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-27T16:30:04.086 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T16:30:04.086 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T16:30:04.090 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-27T16:30:04.091 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-27T16:30:04.093 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-27T16:30:04.168 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-27T16:30:04.175 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-27T16:30:04.178 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-27T16:30:04.178 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-27T16:30:04.179 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-27T16:30:04.180 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-27T16:30:04.181 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-27T16:30:04.247 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-27T16:30:04.248 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-27T16:30:04.629 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-27T16:30:04.652 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-27T16:30:04.654 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-27T16:30:04.731 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-27T16:30:04.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-27T16:30:04.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-27T16:30:04.733 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-27T16:30:04.737 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-27T16:30:04.737 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-27T16:30:04.738 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-27T16:30:04.786 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-27T16:30:04.792 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-27T16:30:04.865 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-27T16:30:04.865 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-27T16:30:04.869 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-27T16:30:04.871 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-27T16:30:04.871 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-27T16:30:04.874 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-27T16:30:04.877 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-27T16:30:04.881 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-27T16:30:04.942 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-27T16:30:04.943 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-27T16:30:05.021 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-27T16:30:05.023 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-27T16:30:05.039 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-27T16:30:05.039 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-27T16:30:05.040 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-27T16:30:05.040 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-27T16:30:05.041 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-27T16:30:05.042 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-27T16:30:05.099 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-27T16:30:05.099 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-27T16:30:05.602 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-142-g9f8421bb-1focal [5,863 kB] 2021-01-27T16:30:05.938 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-142-g9f8421bb-1focal [180 kB] 2021-01-27T16:30:05.943 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-142-g9f8421bb-1focal [1,461 kB] 2021-01-27T16:30:06.027 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-142-g9f8421bb-1focal [6,917 kB] 2021-01-27T16:30:06.476 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-142-g9f8421bb-1focal [25.9 MB] 2021-01-27T16:30:06.728 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-142-g9f8421bb-1focal [5,863 kB] 2021-01-27T16:30:07.334 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-142-g9f8421bb-1focal [180 kB] 2021-01-27T16:30:07.354 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-142-g9f8421bb-1focal [1,461 kB] 2021-01-27T16:30:07.476 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-142-g9f8421bb-1focal [6,917 kB] 2021-01-27T16:30:08.198 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-142-g9f8421bb-1focal [25.9 MB] 2021-01-27T16:30:08.259 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-142-g9f8421bb-1focal [3,808 B] 2021-01-27T16:30:08.259 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-142-g9f8421bb-1focal [809 kB] 2021-01-27T16:30:08.325 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-142-g9f8421bb-1focal [2,302 kB] 2021-01-27T16:30:08.468 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-142-g9f8421bb-1focal [60.8 kB] 2021-01-27T16:30:08.469 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-142-g9f8421bb-1focal [63.9 kB] 2021-01-27T16:30:08.471 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-142-g9f8421bb-1focal [2,327 kB] 2021-01-27T16:30:08.611 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-142-g9f8421bb-1focal [7,898 kB] 2021-01-27T16:30:09.142 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-142-g9f8421bb-1focal [3,924 B] 2021-01-27T16:30:09.142 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-142-g9f8421bb-1focal [22.6 kB] 2021-01-27T16:30:09.161 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-142-g9f8421bb-1focal [48.1 MB] 2021-01-27T16:30:10.791 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-142-g9f8421bb-1focal [3,808 B] 2021-01-27T16:30:10.792 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-142-g9f8421bb-1focal [809 kB] 2021-01-27T16:30:10.853 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-142-g9f8421bb-1focal [2,302 kB] 2021-01-27T16:30:11.060 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-142-g9f8421bb-1focal [60.8 kB] 2021-01-27T16:30:11.061 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-142-g9f8421bb-1focal [63.9 kB] 2021-01-27T16:30:11.062 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-142-g9f8421bb-1focal [2,327 kB] 2021-01-27T16:30:11.329 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-142-g9f8421bb-1focal [7,898 kB] 2021-01-27T16:30:12.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-142-g9f8421bb-1focal [19.8 kB] 2021-01-27T16:30:12.003 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-142-g9f8421bb-1focal [10.7 MB] 2021-01-27T16:30:12.105 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-142-g9f8421bb-1focal [3,924 B] 2021-01-27T16:30:12.105 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-142-g9f8421bb-1focal [22.6 kB] 2021-01-27T16:30:12.106 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-142-g9f8421bb-1focal [48.1 MB] 2021-01-27T16:30:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-142-g9f8421bb-1focal [77.9 kB] 2021-01-27T16:30:13.193 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 169 MB in 11s (16.0 MB/s) 2021-01-27T16:30:13.260 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjaeger. 2021-01-27T16:30:13.316 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T16:30:13.320 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-libjaeger_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:13.349 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjaeger (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:13.727 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T16:30:13.744 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T16:30:13.827 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T16:30:14.205 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-librbd1_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:14.364 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (17.0.0-142-g9f8421bb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-27T16:30:15.039 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-librados2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:15.151 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (17.0.0-142-g9f8421bb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-27T16:30:15.853 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T16:30:15.872 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:15.913 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:16.266 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2021-01-27T16:30:16.282 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-python3-rados_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:16.324 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:16.677 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T16:30:16.696 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:16.741 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-142-g9f8421bb-1focal [19.8 kB] 2021-01-27T16:30:16.742 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-142-g9f8421bb-1focal [10.7 MB] 2021-01-27T16:30:16.743 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:17.004 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T16:30:17.021 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:17.096 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:17.397 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-sage-testing-2021-01-26-2148/9f8421bb8d39043f85c071a52714801b60d36be5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-142-g9f8421bb-1focal [77.9 kB] 2021-01-27T16:30:17.457 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T16:30:17.476 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:17.515 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:17.835 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T16:30:17.854 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T16:30:17.893 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T16:30:18.022 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 169 MB in 16s (10.9 MB/s) 2021-01-27T16:30:18.125 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjaeger. 2021-01-27T16:30:18.170 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T16:30:18.183 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-27T16:30:18.187 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:18.188 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-libjaeger_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:18.228 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:18.231 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjaeger (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:18.592 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-27T16:30:18.607 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T16:30:18.608 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-27T16:30:18.624 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T16:30:18.673 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T16:30:18.734 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T16:30:19.026 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T16:30:19.044 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T16:30:19.066 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-librbd1_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:19.084 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T16:30:19.221 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (17.0.0-142-g9f8421bb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-27T16:30:19.462 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2021-01-27T16:30:19.480 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-librgw2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:19.520 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:19.833 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-librados2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:19.992 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (17.0.0-142-g9f8421bb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-27T16:30:20.123 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T16:30:20.140 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:20.206 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:20.534 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T16:30:20.553 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T16:30:20.583 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T16:30:20.646 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2021-01-27T16:30:20.663 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:20.737 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:20.953 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0. 2021-01-27T16:30:20.974 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T16:30:21.011 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T16:30:21.098 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2021-01-27T16:30:21.118 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-python3-rados_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:21.156 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:21.331 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T16:30:21.350 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:21.388 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:21.509 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-27T16:30:21.530 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:21.567 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:21.820 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2021-01-27T16:30:21.834 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2021-01-27T16:30:21.838 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:21.850 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-ceph-common_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:21.883 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:21.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:22.197 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-27T16:30:22.217 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:22.272 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:22.583 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2021-01-27T16:30:22.601 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-27T16:30:22.658 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-27T16:30:22.886 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2021-01-27T16:30:22.903 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:22.936 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:23.330 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-27T16:30:23.348 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-27T16:30:23.413 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T16:30:23.769 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-27T16:30:23.790 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-27T16:30:23.832 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T16:30:24.175 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2021-01-27T16:30:24.192 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-ceph-base_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:24.194 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2021-01-27T16:30:24.211 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../13-librgw2_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:24.243 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:24.244 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:24.855 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2021-01-27T16:30:24.872 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:24.946 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:25.230 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T16:30:25.250 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T16:30:25.265 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-27T16:30:25.284 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-27T16:30:25.288 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T16:30:25.340 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T16:30:25.591 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T16:30:25.608 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:25.672 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:25.735 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0. 2021-01-27T16:30:25.752 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-27T16:30:25.793 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-27T16:30:26.038 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2021-01-27T16:30:26.055 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:26.055 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T16:30:26.075 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T16:30:26.104 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:26.114 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T16:30:26.442 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T16:30:26.460 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T16:30:26.500 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T16:30:26.582 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2021-01-27T16:30:26.600 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../18-ceph-common_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:26.640 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:26.862 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T16:30:26.882 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T16:30:26.937 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T16:30:27.299 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T16:30:27.316 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T16:30:27.357 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T16:30:27.677 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2021-01-27T16:30:27.695 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T16:30:27.735 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T16:30:28.090 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T16:30:28.108 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T16:30:28.148 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T16:30:28.526 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T16:30:28.544 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T16:30:28.584 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T16:30:28.913 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2021-01-27T16:30:28.929 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T16:30:28.970 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T16:30:28.996 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2021-01-27T16:30:29.013 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../19-ceph-base_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:29.065 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:29.308 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T16:30:29.325 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T16:30:29.388 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T16:30:29.719 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T16:30:29.739 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T16:30:29.777 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T16:30:29.992 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2021-01-27T16:30:30.008 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-27T16:30:30.075 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-27T16:30:30.157 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T16:30:30.175 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T16:30:30.226 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T16:30:30.319 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-27T16:30:30.339 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:30.377 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:30.631 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T16:30:30.650 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T16:30:30.693 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T16:30:30.774 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-27T16:30:30.792 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-27T16:30:30.848 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T16:30:31.030 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2021-01-27T16:30:31.047 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T16:30:31.088 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T16:30:31.152 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-27T16:30:31.168 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-27T16:30:31.235 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-27T16:30:31.451 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T16:30:31.470 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T16:30:31.509 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T16:30:31.605 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2021-01-27T16:30:31.624 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-27T16:30:31.663 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-27T16:30:31.845 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T16:30:31.862 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T16:30:31.928 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T16:30:31.999 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-27T16:30:32.016 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-27T16:30:32.057 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-27T16:30:32.257 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T16:30:32.274 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T16:30:32.315 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T16:30:32.427 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2021-01-27T16:30:32.444 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-27T16:30:32.485 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T16:30:32.686 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T16:30:32.702 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T16:30:32.872 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-27T16:30:32.888 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-27T16:30:32.929 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-27T16:30:33.086 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T16:30:33.257 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-27T16:30:33.275 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-27T16:30:33.315 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T16:30:33.619 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2021-01-27T16:30:33.636 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-27T16:30:33.677 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-27T16:30:33.784 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T16:30:33.800 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T16:30:33.841 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T16:30:34.021 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-27T16:30:34.042 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-27T16:30:34.079 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T16:30:34.271 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T16:30:34.291 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:34.328 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:34.407 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bs4. 2021-01-27T16:30:34.424 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-27T16:30:34.465 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-27T16:30:34.849 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T16:30:34.868 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2021-01-27T16:30:34.870 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:34.885 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-27T16:30:34.930 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-27T16:30:34.932 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:35.280 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2021-01-27T16:30:35.296 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-27T16:30:35.338 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-27T16:30:35.649 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2021-01-27T16:30:35.669 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-27T16:30:35.707 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T16:30:36.003 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T16:30:36.023 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:36.060 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-27T16:30:36.061 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:36.077 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-27T16:30:36.118 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T16:30:36.455 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-27T16:30:36.472 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-27T16:30:36.513 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-27T16:30:36.849 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2021-01-27T16:30:36.870 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-27T16:30:36.907 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-27T16:30:37.235 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2021-01-27T16:30:37.252 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-27T16:30:37.293 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T16:30:37.673 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-27T16:30:37.691 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-27T16:30:37.754 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T16:30:38.193 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2021-01-27T16:30:38.209 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:38.251 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:38.763 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2021-01-27T16:30:38.780 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:38.821 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:38.943 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2021-01-27T16:30:38.960 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../43-ceph_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:39.026 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:39.371 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T16:30:39.388 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:39.428 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:39.817 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T16:30:39.833 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:39.882 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:39.949 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2021-01-27T16:30:39.967 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:40.007 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:40.458 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2021-01-27T16:30:40.478 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../46-cephadm_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:40.519 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:40.857 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T16:30:40.875 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T16:30:40.914 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T16:30:41.268 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T16:30:41.285 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:41.326 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:41.714 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T16:30:41.734 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T16:30:41.780 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T16:30:42.059 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T16:30:42.079 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T16:30:42.117 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T16:30:42.429 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T16:30:42.445 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T16:30:42.486 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T16:30:42.646 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2021-01-27T16:30:42.663 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../43-ceph_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:42.704 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:42.857 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2021-01-27T16:30:42.873 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T16:30:42.940 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T16:30:43.081 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2021-01-27T16:30:43.102 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:43.315 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:43.335 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T16:30:43.354 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:43.393 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:43.729 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2021-01-27T16:30:43.745 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:43.786 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:44.348 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2021-01-27T16:30:44.364 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../46-cephadm_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:44.388 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T16:30:44.405 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T16:30:44.406 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:44.447 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T16:30:44.700 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2021-01-27T16:30:44.720 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-27T16:30:44.758 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-27T16:30:44.783 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T16:30:44.800 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T16:30:44.875 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T16:30:45.095 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-27T16:30:45.114 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:45.153 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:45.195 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T16:30:45.215 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T16:30:45.261 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T16:30:45.481 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-27T16:30:45.502 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-27T16:30:45.539 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-27T16:30:45.851 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-underscore. 2021-01-27T16:30:45.868 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-27T16:30:45.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T16:30:46.203 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-27T16:30:46.220 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-27T16:30:46.269 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T16:30:46.589 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2021-01-27T16:30:46.607 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-27T16:30:46.639 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-27T16:30:46.707 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T16:30:46.725 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T16:30:46.765 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T16:30:46.992 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-27T16:30:47.013 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:47.050 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:47.353 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T16:30:47.371 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T16:30:47.411 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T16:30:47.849 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T16:30:47.870 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T16:30:47.940 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T16:30:47.983 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-decorator. 2021-01-27T16:30:48.000 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-27T16:30:48.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T16:30:48.402 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-27T16:30:48.420 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-27T16:30:48.460 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T16:30:48.709 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T16:30:48.726 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:48.767 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:48.788 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-scipy. 2021-01-27T16:30:48.805 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-27T16:30:48.838 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-27T16:30:49.996 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T16:30:50.015 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T16:30:50.053 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T16:30:50.240 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-27T16:30:50.257 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-27T16:30:50.314 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T16:30:50.382 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T16:30:50.400 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T16:30:50.440 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T16:30:50.836 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T16:30:50.855 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T16:30:50.894 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T16:30:50.901 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2021-01-27T16:30:50.919 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-27T16:30:50.968 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-27T16:30:51.231 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T16:30:51.248 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T16:30:51.289 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T16:30:51.363 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2021-01-27T16:30:51.380 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-27T16:30:51.446 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T16:30:51.618 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T16:30:51.638 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T16:30:51.676 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T16:30:52.064 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T16:30:52.083 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T16:30:52.130 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T16:30:52.213 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-27T16:30:52.230 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:52.271 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:52.484 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T16:30:52.501 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T16:30:52.542 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T16:30:52.896 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T16:30:52.913 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T16:30:52.970 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T16:30:53.408 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2021-01-27T16:30:53.424 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-27T16:30:53.474 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-27T16:30:53.577 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T16:30:53.595 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:53.634 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:53.752 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-27T16:30:53.770 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-27T16:30:53.843 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T16:30:53.979 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T16:30:53.997 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T16:30:54.037 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T16:30:54.147 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-27T16:30:54.165 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-27T16:30:54.230 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T16:30:54.392 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T16:30:54.411 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T16:30:54.449 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T16:30:54.491 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2021-01-27T16:30:54.508 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-27T16:30:54.540 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-27T16:30:54.772 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T16:30:54.791 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:54.853 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-rook (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:54.855 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2021-01-27T16:30:54.870 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-27T16:30:54.911 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-27T16:30:55.198 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T16:30:55.216 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T16:30:55.256 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T16:30:55.289 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-27T16:30:55.307 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-27T16:30:55.380 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T16:30:55.660 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T16:30:55.677 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T16:30:55.700 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2021-01-27T16:30:55.718 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:30:55.721 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-27T16:30:55.775 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T16:30:56.040 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2021-01-27T16:30:56.059 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T16:30:56.105 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:30:56.144 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-27T16:30:56.162 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-27T16:30:56.211 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T16:30:56.383 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2021-01-27T16:30:56.403 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T16:30:56.441 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T16:30:56.749 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-27T16:30:56.770 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:56.803 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T16:30:56.807 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:56.821 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T16:30:56.862 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T16:30:57.152 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-27T16:30:57.168 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-27T16:30:57.210 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T16:30:57.242 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2021-01-27T16:30:57.260 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../78-ceph-test_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:30:57.325 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:57.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-27T16:30:57.631 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-27T16:30:57.696 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-27T16:30:57.999 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-27T16:30:58.018 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-142-g9f8421bb-1focal_all.deb ... 2021-01-27T16:30:58.074 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-rook (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:30:58.419 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-27T16:30:58.437 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-27T16:30:58.485 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-27T16:30:58.863 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-27T16:30:58.882 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T16:30:58.929 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:30:59.241 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2021-01-27T16:30:59.261 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-27T16:30:59.298 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:30:59.535 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2021-01-27T16:30:59.554 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-27T16:30:59.609 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-27T16:30:59.921 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2021-01-27T16:30:59.942 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-27T16:31:00.017 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-27T16:31:00.425 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2021-01-27T16:31:00.443 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../78-ceph-test_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:00.483 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:01.629 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T16:31:01.650 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:01.687 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:02.108 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T16:31:02.125 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T16:31:02.217 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T16:31:02.757 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T16:31:02.775 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T16:31:02.832 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T16:31:03.161 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-attr. 2021-01-27T16:31:03.178 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T16:31:03.218 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T16:31:03.614 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T16:31:03.632 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T16:31:03.672 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T16:31:04.068 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T16:31:04.085 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T16:31:04.125 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T16:31:04.496 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T16:31:04.515 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T16:31:04.554 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T16:31:04.711 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-27T16:31:04.731 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:04.769 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:05.119 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T16:31:05.136 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T16:31:05.176 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T16:31:05.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2021-01-27T16:31:05.232 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-27T16:31:05.290 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T16:31:05.514 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T16:31:05.535 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T16:31:05.596 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T16:31:05.829 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-27T16:31:05.847 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-27T16:31:05.887 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T16:31:05.943 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T16:31:05.963 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T16:31:06.000 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T16:31:06.248 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-attr. 2021-01-27T16:31:06.265 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-27T16:31:06.306 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-27T16:31:06.380 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T16:31:06.397 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T16:31:06.439 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T16:31:06.709 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webencodings. 2021-01-27T16:31:06.727 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-27T16:31:06.767 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T16:31:06.858 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2021-01-27T16:31:06.875 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T16:31:06.919 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T16:31:07.104 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-html5lib. 2021-01-27T16:31:07.120 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-27T16:31:07.162 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-27T16:31:07.328 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T16:31:07.347 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T16:31:07.386 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T16:31:07.532 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-27T16:31:07.553 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-27T16:31:07.590 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T16:31:07.723 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T16:31:07.740 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T16:31:07.806 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T16:31:08.060 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-packaging. 2021-01-27T16:31:08.081 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-27T16:31:08.102 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T16:31:08.118 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-27T16:31:08.120 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T16:31:08.151 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T16:31:08.454 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2021-01-27T16:31:08.471 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-27T16:31:08.536 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-27T16:31:08.623 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2021-01-27T16:31:08.640 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../94-radosgw_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:08.689 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:08.874 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2021-01-27T16:31:08.891 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-27T16:31:08.957 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-27T16:31:09.252 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2021-01-27T16:31:09.269 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-27T16:31:09.335 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T16:31:09.713 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2021-01-27T16:31:09.731 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-27T16:31:09.771 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-27T16:31:09.936 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T16:31:09.955 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:09.994 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:10.125 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-27T16:31:10.143 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-27T16:31:10.191 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T16:31:10.317 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T16:31:10.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-27T16:31:10.563 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-27T16:31:10.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T16:31:10.641 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T16:31:10.750 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T16:31:10.902 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T16:31:10.939 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2021-01-27T16:31:10.957 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-27T16:31:10.996 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-27T16:31:11.112 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:11.476 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2021-01-27T16:31:11.492 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../94-radosgw_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:11.534 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:11.874 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2021-01-27T16:31:12.036 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T16:31:12.454 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T16:31:12.654 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2021-01-27T16:31:12.671 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-142-g9f8421bb-1focal_amd64.deb ... 2021-01-27T16:31:12.711 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:12.764 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T16:31:12.915 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T16:31:13.022 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-27T16:31:13.209 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T16:31:13.350 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-27T16:31:13.467 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-27T16:31:13.586 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-27T16:31:13.619 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T16:31:13.780 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:13.912 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T16:31:14.456 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T16:31:14.757 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T16:31:15.048 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2021-01-27T16:31:15.058 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:15.209 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-27T16:31:15.334 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T16:31:15.469 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T16:31:15.546 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-27T16:31:15.754 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T16:31:15.803 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-27T16:31:15.938 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-27T16:31:16.047 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T16:31:16.273 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-27T16:31:16.423 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T16:31:16.700 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-27T16:31:16.724 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T16:31:16.993 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-27T16:31:17.026 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjaeger (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:17.177 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T16:31:17.344 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-27T16:31:17.504 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T16:31:17.636 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-27T16:31:17.780 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T16:31:17.963 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:18.065 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T16:31:18.216 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T16:31:18.289 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-27T16:31:18.415 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-27T16:31:18.501 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T16:31:18.724 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-27T16:31:18.886 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T16:31:19.025 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-27T16:31:19.288 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T16:31:19.414 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:19.443 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-27T16:31:19.719 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-27T16:31:19.724 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T16:31:20.029 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjaeger (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:20.076 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T16:31:20.163 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-27T16:31:20.218 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T16:31:20.353 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T16:31:20.498 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-27T16:31:20.663 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T16:31:20.807 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-27T16:31:20.964 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T16:31:21.108 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-27T16:31:21.276 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-27T16:31:21.307 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T16:31:21.586 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-27T16:31:21.634 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T16:31:21.935 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T16:31:22.004 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-27T16:31:22.287 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:22.381 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-27T16:31:22.438 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T16:31:22.506 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:22.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T16:31:22.816 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-27T16:31:22.882 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T16:31:23.184 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-27T16:31:23.200 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T16:31:23.335 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-27T16:31:23.494 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-27T16:31:23.535 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T16:31:23.787 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-27T16:31:23.900 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T16:31:24.105 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-27T16:31:24.205 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T16:31:24.331 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T16:31:24.415 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-27T16:31:24.624 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T16:31:24.741 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-27T16:31:24.959 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T16:31:25.034 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-27T16:31:25.294 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T16:31:25.335 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:25.437 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T16:31:25.486 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-27T16:31:25.563 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T16:31:25.612 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-27T16:31:25.889 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-27T16:31:25.923 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:26.074 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T16:31:26.181 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-27T16:31:26.526 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-27T16:31:26.855 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-27T16:31:27.135 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-27T16:31:27.311 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-27T16:31:27.539 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:27.604 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-27T16:31:27.665 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:31:27.833 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T16:31:27.974 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-27T16:31:28.193 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T16:31:28.275 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T16:31:28.367 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-27T16:31:28.495 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T16:31:28.518 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-27T16:31:28.669 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-27T16:31:28.789 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T16:31:29.020 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:29.146 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-27T16:31:29.173 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:29.320 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:29.442 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T16:31:29.760 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T16:31:30.652 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:30.809 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:30.946 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:31:30.946 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-27T16:31:30.946 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T16:31:31.036 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:31:31.179 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T16:31:31.306 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-27T16:31:31.396 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-27T16:31:31.489 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T16:31:31.633 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-27T16:31:31.790 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:31.942 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-27T16:31:32.013 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T16:31:32.013 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T16:31:32.327 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:32.450 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:32.478 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:32.560 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T16:31:32.604 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-27T16:31:32.870 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T16:31:32.955 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-27T16:31:33.281 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:33.407 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:33.533 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:33.676 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T16:31:33.977 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T16:31:34.019 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:34.153 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-27T16:31:34.271 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:34.304 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-27T16:31:34.397 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:34.430 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-27T16:31:34.548 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T16:31:34.732 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-27T16:31:35.033 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:35.259 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T16:31:35.259 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-27T16:31:35.460 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:35.760 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:35.902 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-27T16:31:36.134 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2021-01-27T16:31:36.237 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-27T16:31:36.544 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2021-01-27T16:31:36.598 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:36.732 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:36.762 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2021-01-27T16:31:36.858 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:36.934 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T16:31:37.009 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-27T16:31:37.260 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T16:31:37.319 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-27T16:31:37.658 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:37.717 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:37.788 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:37.868 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:37.914 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-27T16:31:38.141 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T16:31:38.142 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T16:31:38.812 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:38.842 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:39.145 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T16:31:39.514 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2021-01-27T16:31:39.631 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:39.842 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T16:31:39.843 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T16:31:39.899 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2021-01-27T16:31:40.133 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2021-01-27T16:31:40.349 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-27T16:31:40.600 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:40.674 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-27T16:31:40.825 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T16:31:40.825 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T16:31:41.163 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:41.268 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-rook (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:41.288 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:41.411 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:41.565 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T16:31:41.565 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-27T16:31:41.968 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T16:31:41.968 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T16:31:42.291 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:42.422 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:42.540 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:42.623 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-27T16:31:42.699 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:42.927 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T16:31:42.927 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T16:31:43.118 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:43.362 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T16:31:43.363 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-27T16:31:43.384 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:43.527 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:43.687 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:43.836 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:43.853 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T16:31:44.064 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T16:31:44.065 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-27T16:31:44.173 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T16:31:44.587 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-rook (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:44.746 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:45.311 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T16:31:45.311 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-27T16:31:45.824 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:45.950 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:46.105 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:46.325 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T16:31:46.326 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-27T16:31:46.819 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:46.995 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:47.121 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (17.0.0-142-g9f8421bb-1focal) ... 2021-01-27T16:31:47.210 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T16:31:47.282 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-27T16:31:47.583 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-27T16:31:47.647 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T16:31:47.650 DEBUG:teuthology.parallel:result is None 2021-01-27T16:31:50.811 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-27T16:31:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-27T16:31:51.221 DEBUG:teuthology.parallel:result is None 2021-01-27T16:31:51.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-01-27T16:31:51.263 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2021-01-27T16:31:51.510 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:31:51.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:31:51.675 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2021-01-27T16:31:51.701 INFO:teuthology.orchestra.run.smithi106.stdout:17.0.0-142-g9f8421bb-1focal 2021-01-27T16:31:51.702 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-142-g9f8421bb-1focal 2021-01-27T16:31:51.702 INFO:teuthology.task.install:The correct ceph version 17.0.0-142-g9f8421bb-1focal is installed. 2021-01-27T16:31:51.703 DEBUG:teuthology.orchestra.run.smithi094:> sudo lsb_release -is 2021-01-27T16:31:51.755 INFO:teuthology.orchestra.run.smithi094.stdout:Ubuntu 2021-01-27T16:31:51.760 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-27T16:31:51.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:31:51.918 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2021-01-27T16:31:51.945 INFO:teuthology.orchestra.run.smithi094.stdout:17.0.0-142-g9f8421bb-1focal 2021-01-27T16:31:51.946 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-142-g9f8421bb-1focal 2021-01-27T16:31:51.946 INFO:teuthology.task.install:The correct ceph version 17.0.0-142-g9f8421bb-1focal is installed. 2021-01-27T16:31:51.946 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-27T16:31:51.947 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:31:51.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T16:31:51.964 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:31:51.965 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-27T16:31:51.982 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-27T16:31:51.982 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:31:51.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T16:31:52.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T16:31:52.036 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:31:52.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2021-01-27T16:31:52.052 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-27T16:31:52.108 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-27T16:31:52.108 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:31:52.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T16:31:52.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T16:31:52.179 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:31:52.179 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-27T16:31:52.195 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-27T16:31:52.210 INFO:teuthology.run_tasks:Running task cephadm... 2021-01-27T16:31:52.284 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '9f8421bb8d39043f85c071a52714801b60d36be5', 'cephadm_mode': 'cephadm-package'} 2021-01-27T16:31:52.284 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:31:52.285 INFO:tasks.cephadm:Cluster fsid is 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:31:52.285 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-01-27T16:31:52.286 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.106', 'mon.c': '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]', 'mon.b': '172.21.15.94'} 2021-01-27T16:31:52.286 INFO:tasks.cephadm:First mon is mon.a on smithi106 2021-01-27T16:31:52.287 INFO:tasks.cephadm:First mgr is y 2021-01-27T16:31:52.287 INFO:tasks.cephadm:Normalizing hostnames... 2021-01-27T16:31:52.287 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname $(hostname -s) 2021-01-27T16:31:52.305 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname $(hostname -s) 2021-01-27T16:31:52.333 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph 2021-01-27T16:31:52.362 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph 2021-01-27T16:31:52.376 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /etc/ceph 2021-01-27T16:31:52.389 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /etc/ceph 2021-01-27T16:31:52.431 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-01-27T16:31:52.432 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:31:52.432 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T16:31:52.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T16:31:52.438 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi106.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T16:31:52.438 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:31:52.438 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-27T16:31:52.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T16:31:52.445 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi094.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-27T16:31:52.446 INFO:tasks.cephadm:Writing seed config... 2021-01-27T16:31:52.447 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-01-27T16:31:52.447 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-01-27T16:31:52.448 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-01-27T16:31:52.448 INFO:tasks.cephadm: override: [global] ms type = async 2021-01-27T16:31:52.448 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-01-27T16:31:52.448 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-01-27T16:31:52.449 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-01-27T16:31:52.449 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-01-27T16:31:52.449 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-01-27T16:31:52.449 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-01-27T16:31:52.450 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-01-27T16:31:52.450 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-01-27T16:31:52.451 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:31:52.451 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-01-27T16:31:52.457 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 294bdd66-60bd-11eb-8f9a-001a4aab830c mon election default strategy = 3 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-01-27T16:31:52.458 DEBUG:teuthology.orchestra.run.smithi106:mon.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a.service 2021-01-27T16:31:52.503 DEBUG:teuthology.orchestra.run.smithi106:mgr.y> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y.service 2021-01-27T16:31:52.506 INFO:tasks.cephadm:Bootstrapping... 2021-01-27T16:31:52.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -v bootstrap --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.106 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-01-27T16:31:52.550 INFO:journalctl@ceph.mon.a.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:31:52.551 INFO:journalctl@ceph.mgr.y.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:31:52.768 INFO:teuthology.orchestra.run.smithi106.stderr:Could not locate podman: podman not found 2021-01-27T16:31:52.769 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying podman|docker is present... 2021-01-27T16:31:52.769 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying lvm2 is present... 2021-01-27T16:31:52.769 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying time synchronization is in place... 2021-01-27T16:31:52.769 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T16:31:52.776 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for chrony.service: No such file or directory 2021-01-27T16:31:52.777 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.777 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active chrony.service 2021-01-27T16:31:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T16:31:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for chronyd.service: No such file or directory 2021-01-27T16:31:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T16:31:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T16:31:52.803 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutmasked 2021-01-27T16:31:52.803 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.804 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T16:31:52.809 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.810 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.810 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T16:31:52.816 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for ntpd.service: No such file or directory 2021-01-27T16:31:52.816 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.817 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T16:31:52.822 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.822 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.823 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T16:31:52.828 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutenabled 2021-01-27T16:31:52.829 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.829 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active ntp.service 2021-01-27T16:31:52.834 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutactive 2021-01-27T16:31:52.835 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.837 INFO:teuthology.orchestra.run.smithi106.stderr:Unit ntp.service is enabled and running 2021-01-27T16:31:52.837 INFO:teuthology.orchestra.run.smithi106.stderr:Repeating the final host check... 2021-01-27T16:31:52.837 INFO:teuthology.orchestra.run.smithi106.stderr:Could not locate podman: podman not found 2021-01-27T16:31:52.838 INFO:teuthology.orchestra.run.smithi106.stderr:podman|docker (/usr/bin/docker) is present 2021-01-27T16:31:52.838 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl is present 2021-01-27T16:31:52.838 INFO:teuthology.orchestra.run.smithi106.stderr:lvcreate is present 2021-01-27T16:31:52.839 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled chrony.service 2021-01-27T16:31:52.841 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for chrony.service: No such file or directory 2021-01-27T16:31:52.841 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.842 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active chrony.service 2021-01-27T16:31:52.848 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.848 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.849 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-27T16:31:52.854 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for chronyd.service: No such file or directory 2021-01-27T16:31:52.855 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.855 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active chronyd.service 2021-01-27T16:31:52.861 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.861 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.862 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-27T16:31:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutmasked 2021-01-27T16:31:52.868 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.869 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-27T16:31:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.874 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.875 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-27T16:31:52.880 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to get unit file state for ntpd.service: No such file or directory 2021-01-27T16:31:52.881 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:31:52.881 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active ntpd.service 2021-01-27T16:31:52.888 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutinactive 2021-01-27T16:31:52.888 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.889 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-enabled ntp.service 2021-01-27T16:31:52.895 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutenabled 2021-01-27T16:31:52.896 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.896 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl is-active ntp.service 2021-01-27T16:31:52.902 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdoutactive 2021-01-27T16:31:52.902 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stdout 2021-01-27T16:31:52.903 INFO:teuthology.orchestra.run.smithi106.stderr:Unit ntp.service is enabled and running 2021-01-27T16:31:52.903 INFO:teuthology.orchestra.run.smithi106.stderr:Host looks OK 2021-01-27T16:31:52.903 INFO:teuthology.orchestra.run.smithi106.stderr:Cluster fsid: 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:31:52.904 INFO:teuthology.orchestra.run.smithi106.stderr:Acquiring lock 139938434476016 on /run/cephadm/294bdd66-60bd-11eb-8f9a-001a4aab830c.lock 2021-01-27T16:31:52.904 INFO:teuthology.orchestra.run.smithi106.stderr:Lock 139938434476016 acquired on /run/cephadm/294bdd66-60bd-11eb-8f9a-001a4aab830c.lock 2021-01-27T16:31:52.904 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying IP 172.21.15.106 port 3300 ... 2021-01-27T16:31:52.905 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying IP 172.21.15.106 port 6789 ... 2021-01-27T16:31:52.905 INFO:teuthology.orchestra.run.smithi106.stderr:Base mon IP is 172.21.15.106, final addrv is [v2:172.21.15.106:3300,v1:172.21.15.106:6789] 2021-01-27T16:31:52.905 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/sbin/ip route ls 2021-01-27T16:31:52.907 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdoutdefault via 172.21.15.254 dev enp3s0f1 2021-01-27T16:31:52.908 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdoutdefault via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.106 metric 100 2021-01-27T16:31:52.908 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-01-27T16:31:52.908 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.909 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.106 2021-01-27T16:31:52.909 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.106 metric 100 2021-01-27T16:31:52.909 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.910 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/sbin/ip -6 route ls 2021-01-27T16:31:52.912 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout::1 dev lo proto kernel metric 256 pref medium 2021-01-27T16:31:52.912 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.913 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdoutfe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-01-27T16:31:52.913 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdoutdefault via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1761sec pref medium 2021-01-27T16:31:52.913 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.913 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-01-27T16:31:52.916 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-01-27T16:31:52.916 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2021-01-27T16:31:52.916 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2021-01-27T16:31:52.916 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-01-27T16:31:52.917 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.917 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2021-01-27T16:31:52.917 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2021-01-27T16:31:52.917 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/sbin/ip: stdout 2021-01-27T16:31:52.918 INFO:teuthology.orchestra.run.smithi106.stderr:Mon IP 172.21.15.106 is in CIDR network 172.21.0.0/20 2021-01-27T16:31:52.918 INFO:teuthology.orchestra.run.smithi106.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5... 2021-01-27T16:31:52.919 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:31:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout9f8421bb8d39043f85c071a52714801b60d36be5: Pulling from ceph-ci/ceph 2021-01-27T16:31:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:31:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout889524391d55: Pulling fs layer 2021-01-27T16:31:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutce7b89e512e1: Pulling fs layer 2021-01-27T16:31:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:31:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout889524391d55: Verifying Checksum 2021-01-27T16:31:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout889524391d55: Download complete 2021-01-27T16:31:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:31:56.357 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutce7b89e512e1: 2021-01-27T16:31:56.358 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutVerifying Checksum 2021-01-27T16:31:56.358 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutce7b89e512e1: Download complete 2021-01-27T16:31:56.358 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:31:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout889524391d55: Pull complete 2021-01-27T16:31:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:32:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutce7b89e512e1: Pull complete 2021-01-27T16:32:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:32:06.765 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutDigest: sha256:b9f9fcb8171fe6e514e90c330db2618e2e9b748a168b5a8c70e000cd76845ff3 2021-01-27T16:32:06.765 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:32:06.815 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutStatus: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:32:06.816 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:32:06.816 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdoutquay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:32:06.817 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/docker: stdout 2021-01-27T16:32:06.821 INFO:teuthology.orchestra.run.smithi106.stderr:Extracting ceph user uid/gid from container image... 2021-01-27T16:32:06.821 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -c %u %g /var/lib/ceph 2021-01-27T16:32:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:stat: stdout167 167 2021-01-27T16:32:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:stat: stdout 2021-01-27T16:32:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:Creating initial keys... 2021-01-27T16:32:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 --gen-print-key 2021-01-27T16:32:19.931 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdoutAQCTlRFgkkvWNxAAVnzXN24MQpDmjmvPQ/vfzg== 2021-01-27T16:32:19.932 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdout 2021-01-27T16:32:20.497 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 --gen-print-key 2021-01-27T16:32:21.412 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdoutAQCVlRFgYXLkGBAAzX0tB3wSERbeEWZPd9/gSg== 2021-01-27T16:32:21.412 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdout 2021-01-27T16:32:21.977 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 --gen-print-key 2021-01-27T16:32:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdoutAQCWlRFgExUgNhAArVZSyr8rDI3WW7tjjEUOpw== 2021-01-27T16:32:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-authtool: stdout 2021-01-27T16:32:23.517 INFO:teuthology.orchestra.run.smithi106.stderr:Creating initial monmap... 2021-01-27T16:32:23.518 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /tmp/ceph-tmp2sj96wfo:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 --create --clobber --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c --addv a [v2:172.21.15.106:3300,v1:172.21.15.106:6789] /tmp/monmap 2021-01-27T16:32:24.490 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: stdout/usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T16:32:24.490 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: stdout/usr/bin/monmaptool: set fsid to 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:24.490 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: stdout/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T16:32:24.491 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: stdout 2021-01-27T16:32:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:monmaptool for a [v2:172.21.15.106:3300,v1:172.21.15.106:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-27T16:32:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: set fsid to 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-27T16:32:25.065 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:32:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:Creating mon... 2021-01-27T16:32:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpickg0vvo:/tmp/keyring:z -v /tmp/ceph-tmp2sj96wfo:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 --mkfs -i a --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-01-27T16:32:26.055 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T16:32:26.055 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 1 imported monmap: 2021-01-27T16:32:26.055 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrepoch 0 2021-01-27T16:32:26.055 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrfsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:26.057 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrlast_changed 2021-01-27T16:32:24.495275+0000 2021-01-27T16:32:26.057 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrcreated 2021-01-27T16:32:24.495275+0000 2021-01-27T16:32:26.057 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrmin_mon_release 0 (unknown) 2021-01-27T16:32:26.057 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrelection_strategy: 1 2021-01-27T16:32:26.058 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2021-01-27T16:32:26.058 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.058 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 0 /usr/bin/ceph-mon: set fsid to 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:26.058 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.058 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T16:32:26.059 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.059 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T16:32:26.061 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T16:32:26.061 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: DB SUMMARY 2021-01-27T16:32:26.061 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.061 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-01-27T16:32:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-01-27T16:32:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T16:32:26.062 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.create_if_missing: 1 2021-01-27T16:32:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T16:32:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.env: 0x557e9e1ee1c0 2021-01-27T16:32:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.fs: Posix File System 2021-01-27T16:32:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.info_log: 0x557e9f258920 2021-01-27T16:32:26.063 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T16:32:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.statistics: (nil) 2021-01-27T16:32:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.use_fsync: 0 2021-01-27T16:32:26.064 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T16:32:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T16:32:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T16:32:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T16:32:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T16:32:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T16:32:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T16:32:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T16:32:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T16:32:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T16:32:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T16:32:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.db_log_dir: 2021-01-27T16:32:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T16:32:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T16:32:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T16:32:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T16:32:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T16:32:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T16:32:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T16:32:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T16:32:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T16:32:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T16:32:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T16:32:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.write_buffer_manager: 0x557e9f21f1d0 2021-01-27T16:32:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T16:32:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T16:32:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T16:32:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T16:32:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T16:32:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T16:32:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T16:32:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T16:32:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T16:32:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.unordered_write: 0 2021-01-27T16:32:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T16:32:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T16:32:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T16:32:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T16:32:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.row_cache: None 2021-01-27T16:32:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.wal_filter: None 2021-01-27T16:32:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T16:32:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T16:32:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T16:32:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T16:32:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T16:32:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T16:32:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T16:32:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T16:32:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T16:32:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T16:32:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T16:32:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T16:32:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T16:32:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T16:32:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T16:32:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T16:32:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T16:32:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T16:32:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T16:32:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T16:32:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T16:32:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.max_open_files: -1 2021-01-27T16:32:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T16:32:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T16:32:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T16:32:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T16:32:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Compression algorithms supported: 2021-01-27T16:32:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T16:32:26.100 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kZSTD supported: 0 2021-01-27T16:32:26.100 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T16:32:26.100 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T16:32:26.100 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T16:32:26.100 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T16:32:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T16:32:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T16:32:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T16:32:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.055+0000 7fea24a80700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-01-27T16:32:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-01-27T16:32:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T16:32:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T16:32:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.merge_operator: 2021-01-27T16:32:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_filter: None 2021-01-27T16:32:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T16:32:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T16:32:26.104 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T16:32:26.104 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557e9f16e1c8) 2021-01-27T16:32:26.104 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2021-01-27T16:32:26.104 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T16:32:26.104 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T16:32:26.105 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2021-01-27T16:32:26.105 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr index_type: 0 2021-01-27T16:32:26.105 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2021-01-27T16:32:26.105 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr index_shortening: 1 2021-01-27T16:32:26.106 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2021-01-27T16:32:26.106 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr hash_index_allow_collision: 1 2021-01-27T16:32:26.106 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr checksum: 1 2021-01-27T16:32:26.106 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr no_block_cache: 0 2021-01-27T16:32:26.106 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_cache: 0x557e9f1a6110 2021-01-27T16:32:26.107 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2021-01-27T16:32:26.107 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_cache_options: 2021-01-27T16:32:26.107 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr capacity : 536870912 2021-01-27T16:32:26.107 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2021-01-27T16:32:26.107 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2021-01-27T16:32:26.108 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2021-01-27T16:32:26.108 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2021-01-27T16:32:26.108 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2021-01-27T16:32:26.108 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_size: 4096 2021-01-27T16:32:26.108 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2021-01-27T16:32:26.109 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2021-01-27T16:32:26.109 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2021-01-27T16:32:26.109 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2021-01-27T16:32:26.109 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr partition_filters: 0 2021-01-27T16:32:26.109 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2021-01-27T16:32:26.110 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T16:32:26.110 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2021-01-27T16:32:26.110 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr verify_compression: 0 2021-01-27T16:32:26.110 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2021-01-27T16:32:26.111 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr format_version: 2 2021-01-27T16:32:26.111 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2021-01-27T16:32:26.111 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr block_align: 0 2021-01-27T16:32:26.111 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.111 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T16:32:26.112 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T16:32:26.112 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression: NoCompression 2021-01-27T16:32:26.112 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T16:32:26.112 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T16:32:26.112 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T16:32:26.113 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.num_levels: 7 2021-01-27T16:32:26.113 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T16:32:26.113 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T16:32:26.113 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T16:32:26.114 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T16:32:26.114 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T16:32:26.114 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T16:32:26.114 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T16:32:26.114 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:32:26.115 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T16:32:26.115 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T16:32:26.115 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T16:32:26.115 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T16:32:26.115 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T16:32:26.116 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:32:26.116 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T16:32:26.116 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T16:32:26.116 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T16:32:26.116 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T16:32:26.117 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T16:32:26.117 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T16:32:26.117 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T16:32:26.117 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T16:32:26.117 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T16:32:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T16:32:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T16:32:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T16:32:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T16:32:26.118 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T16:32:26.119 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T16:32:26.119 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T16:32:26.119 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T16:32:26.119 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T16:32:26.120 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T16:32:26.120 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T16:32:26.120 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T16:32:26.120 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T16:32:26.120 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T16:32:26.121 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T16:32:26.121 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T16:32:26.121 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T16:32:26.121 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T16:32:26.121 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T16:32:26.122 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T16:32:26.122 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T16:32:26.122 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T16:32:26.122 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T16:32:26.122 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T16:32:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T16:32:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T16:32:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T16:32:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T16:32:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T16:32:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T16:32:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T16:32:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T16:32:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T16:32:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T16:32:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T16:32:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T16:32:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.ttl: 2592000 2021-01-27T16:32:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T16:32:26.126 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T16:32:26.126 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.126 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T16:32:26.126 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.127 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.059+0000 7fea24a80700 4 rocksdb: DB pointer 0x557e9f265800 2021-01-27T16:32:26.127 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.063+0000 7fea0d922700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T16:32:26.127 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.063+0000 7fea0d922700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T16:32:26.127 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** DB Stats ** 2021-01-27T16:32:26.127 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrUptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrCumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T16:32:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrCumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T16:32:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrCumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:32:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrInterval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T16:32:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrInterval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T16:32:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrInterval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:32:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** Compaction Stats [default] ** 2021-01-27T16:32:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrLevel Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:26.130 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:32:26.130 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:32:26.130 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.130 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** Compaction Stats [default] ** 2021-01-27T16:32:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrPriority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrUptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrFlush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:26.131 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:32:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:32:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(Keys): cumulative 0, interval 0 2021-01-27T16:32:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrCumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrInterval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrStalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:32:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** File Read Latency Histogram By Level [default] ** 2021-01-27T16:32:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** Compaction Stats [default] ** 2021-01-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrLevel Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** Compaction Stats [default] ** 2021-01-27T16:32:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrPriority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrUptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrFlush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:32:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:32:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrAddFile(Keys): cumulative 0, interval 0 2021-01-27T16:32:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrCumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrInterval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderrStalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:32:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr** File Read Latency Histogram By Level [default] ** 2021-01-27T16:32:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.063+0000 7fea24a80700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-01-27T16:32:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.063+0000 7fea24a80700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-01-27T16:32:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr"debug "2021-01-27T16:32:26.063+0000 7fea24a80700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-01-27T16:32:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph-mon: stderr 2021-01-27T16:32:26.620 INFO:teuthology.orchestra.run.smithi106.stderr:create mon.a on 2021-01-27T16:32:26.621 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:26.627 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl disable ceph.target 2021-01-27T16:32:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrRemoved /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-01-27T16:32:26.641 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:26.843 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl enable ceph.target 2021-01-27T16:32:26.850 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrCreated symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-01-27T16:32:26.851 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:27.046 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl start ceph.target 2021-01-27T16:32:27.052 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl enable ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target 2021-01-27T16:32:27.069 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrCreated symlink /etc/systemd/system/multi-user.target.wants/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target. 2021-01-27T16:32:27.069 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrCreated symlink /etc/systemd/system/ceph.target.wants/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target -> /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target. 2021-01-27T16:32:27.069 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:27.275 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl start ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target 2021-01-27T16:32:27.283 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl daemon-reload 2021-01-27T16:32:27.484 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl stop ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T16:32:27.495 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl reset-failed ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T16:32:27.500 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to reset failed state of unit ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a.service: Unit ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a.service not loaded. 2021-01-27T16:32:27.500 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:27.500 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl enable ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T16:32:27.508 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrCreated symlink /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target.wants/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@.service. 2021-01-27T16:32:27.509 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:27.708 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl start ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T16:32:27.720 INFO:teuthology.orchestra.run.smithi106.stderr:firewalld does not appear to be present 2021-01-27T16:32:27.721 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T16:32:27.721 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T16:32:27.721 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mon to start... 2021-01-27T16:32:27.722 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mon... 2021-01-27T16:32:27.722 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 status 2021-01-27T16:32:27.774 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:27 smithi106 systemd[1]: Started Ceph mon.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:32:29.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:29 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.046026+0000 mon.a (mon.0) 0 : [INF] mkfs 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:29.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:29 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.038753+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T16:32:29.397 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout cluster: 2021-01-27T16:32:29.397 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout id: 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:29.397 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout health: HEALTH_OK 2021-01-27T16:32:29.397 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:29.399 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout services: 2021-01-27T16:32:29.399 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.357415s) 2021-01-27T16:32:29.399 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mgr: no daemons active 2021-01-27T16:32:29.399 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2021-01-27T16:32:29.400 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:29.400 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout data: 2021-01-27T16:32:29.400 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2021-01-27T16:32:29.400 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2021-01-27T16:32:29.401 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2021-01-27T16:32:29.401 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout pgs: 2021-01-27T16:32:29.401 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:29.401 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:30.039 INFO:teuthology.orchestra.run.smithi106.stderr:mon is available 2021-01-27T16:32:30.040 INFO:teuthology.orchestra.run.smithi106.stderr:Assimilating anything we can from ceph.conf... 2021-01-27T16:32:30.040 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z -v /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-01-27T16:32:30.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.044303+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T16:32:30.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.044682+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} 2021-01-27T16:32:30.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.049400+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-01-27T16:32:30.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.054905+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T16:32:30.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: cluster 2021-01-27T16:32:29.056490+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T16:32:30.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:30 smithi106 bash[9428]: audit 2021-01-27T16:32:29.401670+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.106:0/3863533678' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-01-27T16:32:33.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:33.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout[global] 2021-01-27T16:32:33.089 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout fsid = 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:33.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.106:3300,v1:172.21.15.106:6789] 2021-01-27T16:32:33.090 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2021-01-27T16:32:33.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2021-01-27T16:32:33.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2021-01-27T16:32:33.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2021-01-27T16:32:33.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:33.091 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout[mgr] 2021-01-27T16:32:33.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2021-01-27T16:32:33.092 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:33.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout[osd] 2021-01-27T16:32:33.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout osd_map_max_advance = 10 2021-01-27T16:32:33.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout osd_sloppy_crc = true 2021-01-27T16:32:33.093 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:33.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:33 smithi106 bash[9428]: audit 2021-01-27T16:32:33.059121+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.106:0/1711855238' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-01-27T16:32:33.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:33 smithi106 bash[9428]: audit 2021-01-27T16:32:33.085821+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.106:0/1711855238' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-01-27T16:32:34.247 INFO:teuthology.orchestra.run.smithi106.stderr:Generating new minimal ceph.conf... 2021-01-27T16:32:34.247 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z -v /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-01-27T16:32:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:37 smithi106 bash[9428]: audit 2021-01-27T16:32:37.620013+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.106:0/2580990258' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:32:38.530 INFO:teuthology.orchestra.run.smithi106.stderr:Restarting the monitor... 2021-01-27T16:32:38.531 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl restart ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a 2021-01-27T16:32:38.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:38 smithi106 systemd[1]: Stopping Ceph mon.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c... 2021-01-27T16:32:39.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:39 smithi106 bash[9428]: debug 2021-01-27T16:32:39.147+0000 7f2fa04d6700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-01-27T16:32:39.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:39 smithi106 bash[9428]: debug 2021-01-27T16:32:39.147+0000 7f2fa04d6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-01-27T16:32:40.034 INFO:teuthology.orchestra.run.smithi106.stderr:Setting mon public_network... 2021-01-27T16:32:40.035 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config set mon public_network 172.21.0.0/20 2021-01-27T16:32:40.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:40 smithi106 docker[9741]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c-mon.a 2021-01-27T16:32:40.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:40 smithi106 systemd[1]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.a.service: Succeeded. 2021-01-27T16:32:40.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:40 smithi106 systemd[1]: Stopped Ceph mon.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:32:40.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:40 smithi106 systemd[1]: Started Ceph mon.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:32:42.119 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.811+0000 7fb371e0a700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T16:32:42.120 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.811+0000 7fb371e0a700 0 ceph version 17.0.0-142-g9f8421bb (9f8421bb8d39043f85c071a52714801b60d36be5) pacific (dev), process ceph-mon, pid 1 2021-01-27T16:32:42.120 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.811+0000 7fb371e0a700 0 pidfile_write: ignore empty --pid-file 2021-01-27T16:32:42.120 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 0 load: jerasure load: lrc load: isa 2021-01-27T16:32:42.120 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T16:32:42.121 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T16:32:42.121 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T16:32:42.121 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: DB SUMMARY 2021-01-27T16:32:42.121 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T16:32:42.122 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T16:32:42.122 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-01-27T16:32:42.122 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-01-27T16:32:42.122 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 71495 ; 2021-01-27T16:32:42.123 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T16:32:42.123 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T16:32:42.123 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T16:32:42.123 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.env: 0x56191f82f1c0 2021-01-27T16:32:42.123 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.fs: Posix File System 2021-01-27T16:32:42.124 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.info_log: 0x5619213bbe80 2021-01-27T16:32:42.124 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T16:32:42.124 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.statistics: (nil) 2021-01-27T16:32:42.124 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.use_fsync: 0 2021-01-27T16:32:42.124 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T16:32:42.125 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T16:32:42.125 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T16:32:42.125 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T16:32:42.125 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T16:32:42.125 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T16:32:42.126 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T16:32:42.126 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T16:32:42.126 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T16:32:42.126 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T16:32:42.126 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T16:32:42.127 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.db_log_dir: 2021-01-27T16:32:42.127 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-27T16:32:42.127 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T16:32:42.127 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T16:32:42.127 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T16:32:42.128 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T16:32:42.128 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T16:32:42.128 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T16:32:42.128 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T16:32:42.128 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T16:32:42.129 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T16:32:42.129 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T16:32:42.129 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.write_buffer_manager: 0x561921415bf0 2021-01-27T16:32:42.129 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T16:32:42.129 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T16:32:42.130 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T16:32:42.130 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T16:32:42.130 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T16:32:42.130 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T16:32:42.130 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T16:32:42.131 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T16:32:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T16:32:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.unordered_write: 0 2021-01-27T16:32:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T16:32:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T16:32:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T16:32:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T16:32:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.row_cache: None 2021-01-27T16:32:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.wal_filter: None 2021-01-27T16:32:42.134 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T16:32:42.134 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T16:32:42.134 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T16:32:42.134 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T16:32:42.135 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T16:32:42.135 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T16:32:42.135 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T16:32:42.135 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T16:32:42.135 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T16:32:42.136 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T16:32:42.136 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T16:32:42.136 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T16:32:42.136 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T16:32:42.136 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T16:32:42.137 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T16:32:42.137 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T16:32:42.137 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T16:32:42.137 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T16:32:42.137 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T16:32:42.138 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T16:32:42.138 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T16:32:42.138 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_open_files: -1 2021-01-27T16:32:42.138 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T16:32:42.138 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T16:32:42.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T16:32:42.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T16:32:42.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Compression algorithms supported: 2021-01-27T16:32:42.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T16:32:42.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kZSTD supported: 0 2021-01-27T16:32:42.140 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T16:32:42.140 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T16:32:42.140 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T16:32:42.140 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T16:32:42.140 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T16:32:42.141 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T16:32:42.141 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T16:32:42.141 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-01-27T16:32:42.141 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T16:32:42.141 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T16:32:42.142 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.merge_operator: 2021-01-27T16:32:42.142 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_filter: None 2021-01-27T16:32:42.142 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T16:32:42.142 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T16:32:42.142 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5619213641e0) 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cache_index_and_filter_blocks: 1 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: pin_top_level_index_and_filter: 1 2021-01-27T16:32:42.143 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: index_type: 0 2021-01-27T16:32:42.144 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: data_block_index_type: 0 2021-01-27T16:32:42.144 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: index_shortening: 1 2021-01-27T16:32:42.144 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T16:32:42.144 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: hash_index_allow_collision: 1 2021-01-27T16:32:42.144 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: checksum: 1 2021-01-27T16:32:42.145 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: no_block_cache: 0 2021-01-27T16:32:42.145 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_cache: 0x56192139c510 2021-01-27T16:32:42.145 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_cache_name: BinnedLRUCache 2021-01-27T16:32:42.145 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_cache_options: 2021-01-27T16:32:42.145 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: capacity : 536870912 2021-01-27T16:32:42.146 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: num_shard_bits : 4 2021-01-27T16:32:42.146 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: strict_capacity_limit : 0 2021-01-27T16:32:42.146 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: high_pri_pool_ratio: 0.000 2021-01-27T16:32:42.146 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_cache_compressed: (nil) 2021-01-27T16:32:42.147 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: persistent_cache: (nil) 2021-01-27T16:32:42.147 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_size: 4096 2021-01-27T16:32:42.147 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_size_deviation: 10 2021-01-27T16:32:42.147 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_restart_interval: 16 2021-01-27T16:32:42.147 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: index_block_restart_interval: 1 2021-01-27T16:32:42.148 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: metadata_block_size: 4096 2021-01-27T16:32:42.148 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: partition_filters: 0 2021-01-27T16:32:42.148 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: use_delta_encoding: 1 2021-01-27T16:32:42.148 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T16:32:42.148 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: whole_key_filtering: 1 2021-01-27T16:32:42.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: verify_compression: 0 2021-01-27T16:32:42.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: read_amp_bytes_per_bit: 0 2021-01-27T16:32:42.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: format_version: 2 2021-01-27T16:32:42.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: enable_index_compression: 1 2021-01-27T16:32:42.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: block_align: 0 2021-01-27T16:32:42.150 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T16:32:42.150 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T16:32:42.150 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression: NoCompression 2021-01-27T16:32:42.150 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T16:32:42.150 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T16:32:42.151 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T16:32:42.151 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.num_levels: 7 2021-01-27T16:32:42.151 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T16:32:42.151 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T16:32:42.151 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T16:32:42.152 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T16:32:42.152 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T16:32:42.152 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T16:32:42.152 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T16:32:42.152 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:32:42.153 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T16:32:42.153 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T16:32:42.153 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T16:32:42.153 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T16:32:42.153 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T16:32:42.154 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:32:42.154 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T16:32:42.154 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T16:32:42.154 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T16:32:42.154 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T16:32:42.155 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T16:32:42.155 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T16:32:42.155 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T16:32:42.155 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T16:32:42.155 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T16:32:42.156 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T16:32:42.156 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T16:32:42.156 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T16:32:42.156 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T16:32:42.156 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T16:32:42.157 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T16:32:42.157 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T16:32:42.157 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T16:32:42.157 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T16:32:42.157 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T16:32:42.158 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T16:32:42.158 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T16:32:42.158 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T16:32:42.158 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T16:32:42.159 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T16:32:42.159 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T16:32:42.159 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T16:32:42.159 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T16:32:42.159 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T16:32:42.160 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T16:32:42.160 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T16:32:42.160 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T16:32:42.160 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T16:32:42.160 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T16:32:42.161 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T16:32:42.161 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T16:32:42.161 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.815+0000 7fb371e0a700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T16:32:42.161 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T16:32:42.161 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T16:32:42.162 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T16:32:42.162 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T16:32:42.162 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T16:32:42.162 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T16:32:42.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T16:32:42.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T16:32:42.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T16:32:42.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.ttl: 2592000 2021-01-27T16:32:42.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765161824205, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T16:32:42.164 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765161825533, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 67895, "table_properties": {"data_size": 66183, "index_size": 317, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 8932, "raw_average_key_size": 46, "raw_value_size": 61059, "raw_average_value_size": 316, "num_data_blocks": 10, "num_entries": 193, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611765161, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T16:32:42.165 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-01-27T16:32:42.165 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765161826073, "job": 1, "event": "recovery_finished"} 2021-01-27T16:32:42.165 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.819+0000 7fb371e0a700 4 rocksdb: DB pointer 0x56192145b800 2021-01-27T16:32:42.165 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb358c2b700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T16:32:42.165 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb358c2b700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T16:32:42.166 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** DB Stats ** 2021-01-27T16:32:42.166 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:42.166 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T16:32:42.166 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T16:32:42.166 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:32:42.167 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T16:32:42.167 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T16:32:42.167 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:32:42.167 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** Compaction Stats [default] ** 2021-01-27T16:32:42.167 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:42.168 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:42.168 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: L0 2/0 67.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.168 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Sum 2/0 67.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.168 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.168 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** Compaction Stats [default] ** 2021-01-27T16:32:42.169 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:42.169 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:42.169 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.169 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:42.169 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:42.170 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:42.170 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:32:42.170 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:32:42.170 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:32:42.170 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Cumulative compaction: 0.00 GB write, 15.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:42.171 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Interval compaction: 0.00 GB write, 15.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:42.171 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:32:42.171 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:32:42.171 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** Compaction Stats [default] ** 2021-01-27T16:32:42.171 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:42.172 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:42.172 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: L0 2/0 67.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.172 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Sum 2/0 67.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.172 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:32:42.172 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** Compaction Stats [default] ** 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 80.8 0.00 0.00 1 0.001 0 0 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:42.173 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:32:42.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:32:42.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:32:42.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:32:42.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Cumulative compaction: 0.00 GB write, 15.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:42.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:32:42.175 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:32:42.175 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:32:42.175 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] at bind addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:42.175 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 1 mon.a@-1(???) e1 preinit fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:32:42.175 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).mds e1 new map 2021-01-27T16:32:42.176 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).mds e1 print_map 2021-01-27T16:32:42.176 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: e1 2021-01-27T16:32:42.176 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T16:32:42.176 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T16:32:42.176 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: legacy client fscid: -1 2021-01-27T16:32:42.177 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: 2021-01-27T16:32:42.177 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: No filesystems configured 2021-01-27T16:32:42.177 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-01-27T16:32:42.177 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T16:32:42.177 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T16:32:42.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-27T16:32:42.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: audit 2021-01-27T16:32:37.620013+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.106:0/2580990258' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:32:42.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-01-27T16:32:42.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expand map: {default=false} 2021-01-27T16:32:42.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T16:32:42.179 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T16:32:42.179 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expand map: {default=info} 2021-01-27T16:32:42.179 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T16:32:42.179 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T16:32:42.179 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T16:32:42.180 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T16:32:42.180 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T16:32:42.180 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T16:32:42.180 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T16:32:42.180 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: debug 2021-01-27T16:32:41.823+0000 7fb371e0a700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T16:32:42.181 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cluster 2021-01-27T16:32:41.832991+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-27T16:32:42.181 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cluster 2021-01-27T16:32:41.833051+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0]} 2021-01-27T16:32:42.181 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cluster 2021-01-27T16:32:41.833083+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-01-27T16:32:42.181 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cluster 2021-01-27T16:32:41.833108+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-27T16:32:42.181 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:41 smithi106 bash[9795]: cluster 2021-01-27T16:32:41.833488+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-01-27T16:32:42.705 INFO:teuthology.orchestra.run.smithi106.stderr:Wrote config to /etc/ceph/ceph.conf 2021-01-27T16:32:42.706 INFO:teuthology.orchestra.run.smithi106.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-01-27T16:32:42.706 INFO:teuthology.orchestra.run.smithi106.stderr:Creating mgr... 2021-01-27T16:32:42.706 INFO:teuthology.orchestra.run.smithi106.stderr:Verifying port 9283 ... 2021-01-27T16:32:42.708 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl daemon-reload 2021-01-27T16:32:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl stop ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T16:32:42.933 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl reset-failed ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T16:32:42.938 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrFailed to reset failed state of unit ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y.service: Unit ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y.service not loaded. 2021-01-27T16:32:42.938 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:42.939 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl enable ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T16:32:42.947 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderrCreated symlink /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c.target.wants/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@.service. 2021-01-27T16:32:42.947 INFO:teuthology.orchestra.run.smithi106.stderr:systemctl: stderr 2021-01-27T16:32:43.162 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: systemctl start ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.y 2021-01-27T16:32:43.174 INFO:teuthology.orchestra.run.smithi106.stderr:firewalld does not appear to be present 2021-01-27T16:32:43.175 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to enable service . firewalld.service is not available 2021-01-27T16:32:43.176 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-27T16:32:43.176 INFO:teuthology.orchestra.run.smithi106.stderr:firewalld does not appear to be present 2021-01-27T16:32:43.176 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-01-27T16:32:43.176 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mgr to start... 2021-01-27T16:32:43.176 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mgr... 2021-01-27T16:32:43.177 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 status -f json-pretty 2021-01-27T16:32:43.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:43 smithi106 bash[9795]: audit 2021-01-27T16:32:42.074637+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.106:0/1036288160' entity='client.admin' 2021-01-27T16:32:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:44.953 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:32:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsid": "294bdd66-60bd-11eb-8f9a-001a4aab830c", 2021-01-27T16:32:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "health": { 2021-01-27T16:32:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2021-01-27T16:32:44.954 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "checks": {}, 2021-01-27T16:32:44.956 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mutes": [] 2021-01-27T16:32:44.957 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.957 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2021-01-27T16:32:44.957 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum": [ 2021-01-27T16:32:44.957 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 0 2021-01-27T16:32:44.957 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:44.958 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2021-01-27T16:32:44.958 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "a" 2021-01-27T16:32:44.958 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:44.958 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_age": 3, 2021-01-27T16:32:44.959 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "monmap": { 2021-01-27T16:32:44.959 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:44.959 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "pacific", 2021-01-27T16:32:44.959 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_mons": 1 2021-01-27T16:32:44.959 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.960 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osdmap": { 2021-01-27T16:32:44.960 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:44.960 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2021-01-27T16:32:44.960 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2021-01-27T16:32:44.960 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2021-01-27T16:32:44.964 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2021-01-27T16:32:44.964 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2021-01-27T16:32:44.964 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2021-01-27T16:32:44.964 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.965 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgmap": { 2021-01-27T16:32:44.965 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2021-01-27T16:32:44.965 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2021-01-27T16:32:44.965 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2021-01-27T16:32:44.965 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2021-01-27T16:32:44.966 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2021-01-27T16:32:44.966 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2021-01-27T16:32:44.966 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2021-01-27T16:32:44.966 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2021-01-27T16:32:44.967 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.967 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsmap": { 2021-01-27T16:32:44.967 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:44.967 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "by_rank": [], 2021-01-27T16:32:44.968 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "up:standby": 0 2021-01-27T16:32:44.968 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.968 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mgrmap": { 2021-01-27T16:32:44.968 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "available": false, 2021-01-27T16:32:44.968 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2021-01-27T16:32:44.969 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modules": [ 2021-01-27T16:32:44.969 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "iostat", 2021-01-27T16:32:44.969 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "restful" 2021-01-27T16:32:44.969 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:44.970 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:44.970 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.970 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "servicemap": { 2021-01-27T16:32:44.970 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:44.970 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modified": "2021-01-27T16:32:29.046983+0000", 2021-01-27T16:32:44.971 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:44.971 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:44.971 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "progress_events": {} 2021-01-27T16:32:44.971 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:32:44.971 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:45.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:45 smithi106 bash[9795]: audit 2021-01-27T16:32:44.958284+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.106:0/1098438615' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T16:32:45.606 INFO:teuthology.orchestra.run.smithi106.stderr:mgr not available, waiting (1/15)... 2021-01-27T16:32:47.609 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 status -f json-pretty 2021-01-27T16:32:48.779 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:32:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsid": "294bdd66-60bd-11eb-8f9a-001a4aab830c", 2021-01-27T16:32:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "health": { 2021-01-27T16:32:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2021-01-27T16:32:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "checks": {}, 2021-01-27T16:32:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mutes": [] 2021-01-27T16:32:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2021-01-27T16:32:48.782 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum": [ 2021-01-27T16:32:48.782 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 0 2021-01-27T16:32:48.782 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:48.782 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2021-01-27T16:32:48.783 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "a" 2021-01-27T16:32:48.783 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:48.783 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_age": 6, 2021-01-27T16:32:48.783 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "monmap": { 2021-01-27T16:32:48.783 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:48.784 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "pacific", 2021-01-27T16:32:48.784 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_mons": 1 2021-01-27T16:32:48.784 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.784 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osdmap": { 2021-01-27T16:32:48.785 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:48.785 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2021-01-27T16:32:48.785 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2021-01-27T16:32:48.785 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2021-01-27T16:32:48.785 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2021-01-27T16:32:48.786 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2021-01-27T16:32:48.786 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2021-01-27T16:32:48.786 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.786 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgmap": { 2021-01-27T16:32:48.787 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2021-01-27T16:32:48.787 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2021-01-27T16:32:48.787 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2021-01-27T16:32:48.787 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2021-01-27T16:32:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2021-01-27T16:32:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2021-01-27T16:32:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2021-01-27T16:32:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2021-01-27T16:32:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsmap": { 2021-01-27T16:32:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "by_rank": [], 2021-01-27T16:32:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "up:standby": 0 2021-01-27T16:32:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mgrmap": { 2021-01-27T16:32:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "available": false, 2021-01-27T16:32:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2021-01-27T16:32:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modules": [ 2021-01-27T16:32:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "iostat", 2021-01-27T16:32:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "restful" 2021-01-27T16:32:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "servicemap": { 2021-01-27T16:32:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modified": "2021-01-27T16:32:29.046983+0000", 2021-01-27T16:32:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "progress_events": {} 2021-01-27T16:32:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:32:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:49.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:48 smithi106 bash[9795]: audit 2021-01-27T16:32:48.780575+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.106:0/3605632041' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T16:32:49.362 INFO:teuthology.orchestra.run.smithi106.stderr:mgr not available, waiting (2/15)... 2021-01-27T16:32:50.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: cluster 2021-01-27T16:32:50.545207+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-01-27T16:32:50.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: cluster 2021-01-27T16:32:50.549269+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00425915s) 2021-01-27T16:32:50.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.552501+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T16:32:50.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.553155+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T16:32:50.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.553791+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T16:32:50.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.554409+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T16:32:50.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.554796+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T16:32:50.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: cluster 2021-01-27T16:32:50.559483+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-01-27T16:32:50.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.574443+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' 2021-01-27T16:32:50.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.581515+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:32:50.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.583805+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:32:50.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:50 smithi106 bash[9795]: audit 2021-01-27T16:32:50.594674+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' 2021-01-27T16:32:51.364 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 status -f json-pretty 2021-01-27T16:32:51.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:51 smithi106 bash[9795]: audit 2021-01-27T16:32:50.600209+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.106:0/1501496116' entity='mgr.y' 2021-01-27T16:32:51.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:51 smithi106 bash[9795]: cluster 2021-01-27T16:32:51.556362+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01134s) 2021-01-27T16:32:52.999 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:53.000 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:32:53.000 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsid": "294bdd66-60bd-11eb-8f9a-001a4aab830c", 2021-01-27T16:32:53.000 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "health": { 2021-01-27T16:32:53.001 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2021-01-27T16:32:53.001 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "checks": {}, 2021-01-27T16:32:53.001 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mutes": [] 2021-01-27T16:32:53.003 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.004 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "election_epoch": 5, 2021-01-27T16:32:53.004 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum": [ 2021-01-27T16:32:53.004 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 0 2021-01-27T16:32:53.004 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:53.005 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_names": [ 2021-01-27T16:32:53.005 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "a" 2021-01-27T16:32:53.005 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:53.005 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "quorum_age": 11, 2021-01-27T16:32:53.006 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "monmap": { 2021-01-27T16:32:53.006 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:53.006 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "min_mon_release_name": "pacific", 2021-01-27T16:32:53.006 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_mons": 1 2021-01-27T16:32:53.007 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.007 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osdmap": { 2021-01-27T16:32:53.007 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:53.007 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_osds": 0, 2021-01-27T16:32:53.008 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_up_osds": 0, 2021-01-27T16:32:53.008 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_up_since": 0, 2021-01-27T16:32:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_in_osds": 0, 2021-01-27T16:32:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "osd_in_since": 0, 2021-01-27T16:32:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2021-01-27T16:32:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgmap": { 2021-01-27T16:32:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "pgs_by_state": [], 2021-01-27T16:32:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pgs": 0, 2021-01-27T16:32:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_pools": 0, 2021-01-27T16:32:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_objects": 0, 2021-01-27T16:32:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "data_bytes": 0, 2021-01-27T16:32:53.014 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_used": 0, 2021-01-27T16:32:53.014 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_avail": 0, 2021-01-27T16:32:53.014 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "bytes_total": 0 2021-01-27T16:32:53.014 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.014 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "fsmap": { 2021-01-27T16:32:53.015 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:53.015 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "by_rank": [], 2021-01-27T16:32:53.015 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "up:standby": 0 2021-01-27T16:32:53.015 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.016 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mgrmap": { 2021-01-27T16:32:53.016 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "available": true, 2021-01-27T16:32:53.016 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_standbys": 0, 2021-01-27T16:32:53.016 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modules": [ 2021-01-27T16:32:53.016 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "iostat", 2021-01-27T16:32:53.017 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "restful" 2021-01-27T16:32:53.017 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout ], 2021-01-27T16:32:53.017 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:53.017 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.018 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "servicemap": { 2021-01-27T16:32:53.018 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 1, 2021-01-27T16:32:53.018 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "modified": "2021-01-27T16:32:29.046983+0000", 2021-01-27T16:32:53.018 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "services": {} 2021-01-27T16:32:53.019 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout }, 2021-01-27T16:32:53.019 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "progress_events": {} 2021-01-27T16:32:53.019 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:32:53.019 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:32:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:mgr is available 2021-01-27T16:32:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config-key set mgr/cephadm/ssh_user root 2021-01-27T16:32:54.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:53 smithi106 bash[9795]: cluster 2021-01-27T16:32:52.842666+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-01-27T16:32:54.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:53 smithi106 bash[9795]: audit 2021-01-27T16:32:53.004209+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.106:0/3617335265' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-27T16:32:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stderrset mgr/cephadm/ssh_user 2021-01-27T16:32:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stderr 2021-01-27T16:32:55.769 INFO:teuthology.orchestra.run.smithi106.stderr:Enabling cephadm module... 2021-01-27T16:32:55.769 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 mgr module enable cephadm 2021-01-27T16:32:56.624 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:56 smithi106 bash[9795]: audit 2021-01-27T16:32:55.215370+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.106:0/199846589' entity='client.admin' 2021-01-27T16:32:58.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:57 smithi106 bash[9795]: audit 2021-01-27T16:32:57.226579+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.106:0/4041728018' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-01-27T16:32:58.197 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:32:57 smithi106 bash[10032]: ignoring --setgroup ceph since I am not root 2021-01-27T16:32:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 mgr stat 2021-01-27T16:32:59.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:58 smithi106 bash[9795]: audit 2021-01-27T16:32:57.844934+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.106:0/4041728018' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-01-27T16:32:59.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:32:58 smithi106 bash[9795]: cluster 2021-01-27T16:32:57.845055+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 7s) 2021-01-27T16:32:59.987 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:32:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 5, 2021-01-27T16:32:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "available": true, 2021-01-27T16:32:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "active_name": "y", 2021-01-27T16:32:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_standby": 0 2021-01-27T16:32:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:32:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:00.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:00 smithi106 bash[9795]: audit 2021-01-27T16:32:59.992027+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.106:0/139674583' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T16:33:00.689 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for the mgr to restart... 2021-01-27T16:33:00.689 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mgr epoch 5... 2021-01-27T16:33:00.689 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 tell mgr mgr_status 2021-01-27T16:33:04.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:03 smithi106 bash[9795]: cluster 2021-01-27T16:33:03.753301+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-01-27T16:33:04.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:03 smithi106 bash[9795]: cluster 2021-01-27T16:33:03.754078+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-01-27T16:33:04.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:03 smithi106 bash[9795]: cluster 2021-01-27T16:33:03.759778+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-01-27T16:33:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:33:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2021-01-27T16:33:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "initialized": true 2021-01-27T16:33:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:33:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:05.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: cluster 2021-01-27T16:33:03.809316+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.055361s) 2021-01-27T16:33:05.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.816816+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T16:33:05.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.817981+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T16:33:05.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.818248+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T16:33:05.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.818469+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T16:33:05.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.818946+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T16:33:05.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.819884+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T16:33:05.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.820222+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T16:33:05.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.820556+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T16:33:05.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.820862+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T16:33:05.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: cluster 2021-01-27T16:33:03.824279+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2021-01-27T16:33:05.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.848258+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:05.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.851620+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:05.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.856607+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:05.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.992444+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:05.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:03.998622+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:05.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:04.013398+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:33:05.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:04 smithi106 bash[9795]: audit 2021-01-27T16:33:04.016244+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:33:05.515 INFO:teuthology.orchestra.run.smithi106.stderr:mgr epoch 5 is available 2021-01-27T16:33:05.515 INFO:teuthology.orchestra.run.smithi106.stderr:Setting orchestrator backend to cephadm... 2021-01-27T16:33:05.515 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 orch set backend cephadm 2021-01-27T16:33:05.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:05 smithi106 bash[9795]: audit 2021-01-27T16:33:04.818584+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T16:33:05.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:05 smithi106 bash[9795]: cluster 2021-01-27T16:33:04.819763+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.0658s) 2021-01-27T16:33:05.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:05 smithi106 bash[9795]: audit 2021-01-27T16:33:04.835162+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T16:33:07.149 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:06 smithi106 bash[9795]: cluster 2021-01-27T16:33:05.830922+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-01-27T16:33:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:Generating ssh key... 2021-01-27T16:33:07.637 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 cephadm generate-key 2021-01-27T16:33:08.393 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:07 smithi106 bash[9795]: audit 2021-01-27T16:33:06.985343+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:08.393 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:07 smithi106 bash[9795]: audit 2021-01-27T16:33:06.996460+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:08.393 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:07 smithi106 bash[9795]: audit 2021-01-27T16:33:07.008264+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:09.697 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: Generating public/private rsa key pair. 2021-01-27T16:33:09.697 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: Your identification has been saved in /tmp/tmpoqt8_5wo/key. 2021-01-27T16:33:09.698 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: Your public key has been saved in /tmp/tmpoqt8_5wo/key.pub. 2021-01-27T16:33:09.698 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: The key fingerprint is: 2021-01-27T16:33:09.698 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: SHA256:jjFxl2wsDVBkUaCSID1uBM49jjZcW8RbOau98KoNmPQ ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:33:09.699 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: The key's randomart image is: 2021-01-27T16:33:09.699 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: +---[RSA 3072]----+ 2021-01-27T16:33:09.699 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: |oo. ...+O+. | 2021-01-27T16:33:09.699 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: |o.=..o * = . | 2021-01-27T16:33:09.700 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: | = =o.= = B | 2021-01-27T16:33:09.700 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: |. * +o + + | 2021-01-27T16:33:09.700 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: | B o = S | 2021-01-27T16:33:09.700 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: |o = o * | 2021-01-27T16:33:09.700 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: | o E + o | 2021-01-27T16:33:09.701 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: | o o | 2021-01-27T16:33:09.701 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: | ..o. | 2021-01-27T16:33:09.701 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:09 smithi106 bash[10032]: +----[SHA256]-----+ 2021-01-27T16:33:09.885 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 cephadm get-pub-key 2021-01-27T16:33:10.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:10 smithi106 bash[9795]: audit 2021-01-27T16:33:08.930137+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:10.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:10 smithi106 bash[9795]: cephadm 2021-01-27T16:33:08.930566+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2021-01-27T16:33:10.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:10 smithi106 bash[9795]: audit 2021-01-27T16:33:09.211581+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:10.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:10 smithi106 bash[9795]: audit 2021-01-27T16:33:09.214894+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdoutssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sU8MNlEVKZL9OANyUzidheqf/k4EmJyX+S86okxZ63nZuFsEoCiwGIGSUlhbJ4dEZVCB7HfPRfrhbC1d15qLGYsjejb2opd/ZwYeXFYRvyexAxjAbLXQh6ZXf5DlfyLQFB+GQWJ3O7kUg7Yq3xNg4qXoX6/eZRsp1pTa82Zi3p4jTHX8wMkKjTMv8qqvNgcUA5Kt7QieE4HcAxX2JBOjqyEYw6qEh3VuqW8IlueflL94Ng4dVEvLR1TSh5HZulto1bLADqYi2xtV/6dwYpvmYDv/zJDuGSlkf5JQWKPMdFSWpAAR2WzGeYA0diBO735Olkdss8+IoFdmFkXvvObniq7CpXSPH8AHmMXt5nBt1I1lTMvWo3OfDKdl6bctnhh8gLL50AEDw9RPn6iohmf5/k4jLGLKlde+tbTprtvlWcgNIDljE9MsN5RUY2b/Y1wFHDM6F7KtFvLQplPQNsGV7VBdp66d9gWT4ixwHDLSELQcYztgJ4rerqcStS5OZ8s= ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:33:11.351 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:11.983 INFO:teuthology.orchestra.run.smithi106.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-01-27T16:33:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:Adding key to root@localhost's authorized_keys... 2021-01-27T16:33:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:Adding host smithi106... 2021-01-27T16:33:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 orch host add smithi106 2021-01-27T16:33:13.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:12 smithi106 bash[9795]: audit 2021-01-27T16:33:11.355475+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:13.938 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:13 smithi106 bash[10032]: Warning: Permanently added 'smithi106,172.21.15.106' (ECDSA) to the list of known hosts. 2021-01-27T16:33:14.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:13 smithi106 bash[9795]: audit 2021-01-27T16:33:13.426365+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:14.207 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdoutAdded host 'smithi106' 2021-01-27T16:33:14.207 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config set mgr mgr/dashboard/ssl_server_port 8443 2021-01-27T16:33:15.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:15 smithi106 bash[9795]: audit 2021-01-27T16:33:14.207844+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:15.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:15 smithi106 bash[9795]: cephadm 2021-01-27T16:33:14.208622+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi106 2021-01-27T16:33:15.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:15 smithi106 bash[9795]: audit 2021-01-27T16:33:14.622863+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:15.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:15 smithi106 bash[9795]: audit 2021-01-27T16:33:14.624439+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:33:16.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:16 smithi106 bash[9795]: audit 2021-01-27T16:33:15.348585+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' 2021-01-27T16:33:16.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:16 smithi106 bash[9795]: audit 2021-01-27T16:33:15.349595+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.106:0/3605782713' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:33:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:Enabling the dashboard module... 2021-01-27T16:33:17.607 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 mgr module enable dashboard 2021-01-27T16:33:17.746 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:17 smithi106 bash[9795]: audit 2021-01-27T16:33:16.690094+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.106:0/3995718175' entity='client.admin' 2021-01-27T16:33:19.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:19 smithi106 bash[9795]: audit 2021-01-27T16:33:19.283876+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.106:0/2092359249' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-01-27T16:33:19.702 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:19 smithi106 bash[10032]: ignoring --setuser ceph since I am not root 2021-01-27T16:33:19.702 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:19 smithi106 bash[10032]: ignoring --setgroup ceph since I am not root 2021-01-27T16:33:20.035 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 mgr stat 2021-01-27T16:33:20.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:20 smithi106 bash[9795]: audit 2021-01-27T16:33:19.338136+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.106:0/2092359249' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-01-27T16:33:20.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:20 smithi106 bash[9795]: cluster 2021-01-27T16:33:19.338240+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 15s) 2021-01-27T16:33:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:33:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "epoch": 9, 2021-01-27T16:33:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "available": true, 2021-01-27T16:33:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "active_name": "y", 2021-01-27T16:33:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "num_standby": 0 2021-01-27T16:33:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:33:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:21.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:21 smithi106 bash[9795]: audit 2021-01-27T16:33:21.586835+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.106:0/1814135089' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-27T16:33:22.266 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for the mgr to restart... 2021-01-27T16:33:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:Waiting for mgr epoch 9... 2021-01-27T16:33:22.267 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 tell mgr mgr_status 2021-01-27T16:33:25.952 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:33:25 smithi106 bash[10032]: Warning: Permanently added 'smithi106,172.21.15.106' (ECDSA) to the list of known hosts. 2021-01-27T16:33:26.290 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{ 2021-01-27T16:33:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2021-01-27T16:33:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout "initialized": true 2021-01-27T16:33:26.291 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout} 2021-01-27T16:33:26.292 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:26.497 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: cluster 2021-01-27T16:33:25.213290+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2021-01-27T16:33:26.497 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: cluster 2021-01-27T16:33:25.213934+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2021-01-27T16:33:26.497 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: cluster 2021-01-27T16:33:25.218868+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-01-27T16:33:26.498 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: cluster 2021-01-27T16:33:25.271554+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0577755s) 2021-01-27T16:33:26.498 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.275548+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-27T16:33:26.498 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.276990+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-27T16:33:26.498 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.277250+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-27T16:33:26.498 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.277509+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-27T16:33:26.499 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.278161+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-27T16:33:26.499 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.279376+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi106"}]: dispatch 2021-01-27T16:33:26.499 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.279901+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-01-27T16:33:26.499 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.280388+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-01-27T16:33:26.500 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.280852+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-01-27T16:33:26.500 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.281322+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-01-27T16:33:26.500 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.281789+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-27T16:33:26.500 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.282234+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-27T16:33:26.501 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.282656+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-27T16:33:26.501 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.283073+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-27T16:33:26.501 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: cluster 2021-01-27T16:33:25.286138+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2021-01-27T16:33:26.501 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.465962+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:33:26.501 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.468556+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:33:26.502 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:26 smithi106 bash[9795]: audit 2021-01-27T16:33:25.668140+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:33:27.348 INFO:teuthology.orchestra.run.smithi106.stderr:mgr epoch 9 is available 2021-01-27T16:33:27.348 INFO:teuthology.orchestra.run.smithi106.stderr:Generating a dashboard self-signed certificate... 2021-01-27T16:33:27.349 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 dashboard create-self-signed-cert 2021-01-27T16:33:27.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:27 smithi106 bash[9795]: audit 2021-01-27T16:33:26.273038+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-27T16:33:27.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:27 smithi106 bash[9795]: cluster 2021-01-27T16:33:26.274878+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: y(active, since 1.0611s) 2021-01-27T16:33:27.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:27 smithi106 bash[9795]: audit 2021-01-27T16:33:26.290777+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-27T16:33:27.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:27 smithi106 bash[9795]: audit 2021-01-27T16:33:26.353091+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:27.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:27 smithi106 bash[9795]: audit 2021-01-27T16:33:26.354174+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:33:29.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:28 smithi106 bash[9795]: cluster 2021-01-27T16:33:27.852350+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-01-27T16:33:29.436 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdoutSelf-signed certificate created 2021-01-27T16:33:29.437 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:29.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:29 smithi106 bash[9795]: audit 2021-01-27T16:33:29.254272+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:29.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:29 smithi106 bash[9795]: audit 2021-01-27T16:33:29.433563+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:29.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:29 smithi106 bash[9795]: audit 2021-01-27T16:33:29.436307+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:30.088 INFO:teuthology.orchestra.run.smithi106.stderr:Creating initial admin user... 2021-01-27T16:33:30.088 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpdg_zgu69:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-01-27T16:33:31.987 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout{"username": "admin", "password": "$2b$12$82GU2kD6gi.6F0iATNyoX.Czk/4sUag2C4ihtD9wWqxOH0BLBlomG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1611765211, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-01-27T16:33:31.988 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:32.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:32 smithi106 bash[9795]: cluster 2021-01-27T16:33:31.271612+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-01-27T16:33:32.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:32 smithi106 bash[9795]: audit 2021-01-27T16:33:31.987232+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:32.604 INFO:teuthology.orchestra.run.smithi106.stderr:Fetching dashboard port number... 2021-01-27T16:33:32.604 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 -e NODE_NAME=smithi106 -v /var/log/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp47xct3ut:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpl03kna4j:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 config get mgr mgr/dashboard/ssl_server_port 2021-01-27T16:33:33.661 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:33 smithi106 bash[9795]: audit 2021-01-27T16:33:31.744926+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:33:34.206 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout8443 2021-01-27T16:33:34.207 INFO:teuthology.orchestra.run.smithi106.stderr:/usr/bin/ceph: stdout 2021-01-27T16:33:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:34 smithi106 bash[9795]: audit 2021-01-27T16:33:34.206811+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.106:0/3610270894' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-01-27T16:33:34.936 INFO:teuthology.orchestra.run.smithi106.stderr:firewalld does not appear to be present 2021-01-27T16:33:34.936 INFO:teuthology.orchestra.run.smithi106.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-01-27T16:33:34.939 INFO:teuthology.orchestra.run.smithi106.stderr:Ceph Dashboard is now available at: 2021-01-27T16:33:34.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.940 INFO:teuthology.orchestra.run.smithi106.stderr: URL: https://smithi106.front.sepia.ceph.com:8443/ 2021-01-27T16:33:34.940 INFO:teuthology.orchestra.run.smithi106.stderr: User: admin 2021-01-27T16:33:34.941 INFO:teuthology.orchestra.run.smithi106.stderr: Password: m53yabinp7 2021-01-27T16:33:34.941 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.941 INFO:teuthology.orchestra.run.smithi106.stderr:You can access the Ceph CLI with: 2021-01-27T16:33:34.941 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.942 INFO:teuthology.orchestra.run.smithi106.stderr: sudo /usr/sbin/cephadm shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-01-27T16:33:34.942 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.942 INFO:teuthology.orchestra.run.smithi106.stderr:Please consider enabling telemetry to help improve Ceph: 2021-01-27T16:33:34.942 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.942 INFO:teuthology.orchestra.run.smithi106.stderr: ceph telemetry on 2021-01-27T16:33:34.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.943 INFO:teuthology.orchestra.run.smithi106.stderr:For more information see: 2021-01-27T16:33:34.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.943 INFO:teuthology.orchestra.run.smithi106.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-01-27T16:33:34.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2021-01-27T16:33:34.944 INFO:teuthology.orchestra.run.smithi106.stderr:Bootstrap complete. 2021-01-27T16:33:34.944 INFO:teuthology.orchestra.run.smithi106.stderr:Releasing lock 139938434476016 on /run/cephadm/294bdd66-60bd-11eb-8f9a-001a4aab830c.lock 2021-01-27T16:33:34.944 INFO:teuthology.orchestra.run.smithi106.stderr:Lock 139938434476016 released on /run/cephadm/294bdd66-60bd-11eb-8f9a-001a4aab830c.lock 2021-01-27T16:33:34.973 INFO:tasks.cephadm:Fetching config... 2021-01-27T16:33:34.974 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:33:34.975 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-01-27T16:33:34.982 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-01-27T16:33:34.982 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:33:34.983 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-01-27T16:33:34.990 INFO:tasks.cephadm:Fetching mon keyring... 2021-01-27T16:33:34.991 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:33:34.991 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-01-27T16:33:35.047 INFO:tasks.cephadm:Fetching pub ssh key... 2021-01-27T16:33:35.047 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:33:35.047 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-01-27T16:33:35.052 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-01-27T16:33:35.053 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sU8MNlEVKZL9OANyUzidheqf/k4EmJyX+S86okxZ63nZuFsEoCiwGIGSUlhbJ4dEZVCB7HfPRfrhbC1d15qLGYsjejb2opd/ZwYeXFYRvyexAxjAbLXQh6ZXf5DlfyLQFB+GQWJ3O7kUg7Yq3xNg4qXoX6/eZRsp1pTa82Zi3p4jTHX8wMkKjTMv8qqvNgcUA5Kt7QieE4HcAxX2JBOjqyEYw6qEh3VuqW8IlueflL94Ng4dVEvLR1TSh5HZulto1bLADqYi2xtV/6dwYpvmYDv/zJDuGSlkf5JQWKPMdFSWpAAR2WzGeYA0diBO735Olkdss8+IoFdmFkXvvObniq7CpXSPH8AHmMXt5nBt1I1lTMvWo3OfDKdl6bctnhh8gLL50AEDw9RPn6iohmf5/k4jLGLKlde+tbTprtvlWcgNIDljE9MsN5RUY2b/Y1wFHDM6F7KtFvLQplPQNsGV7VBdp66d9gWT4ixwHDLSELQcYztgJ4rerqcStS5OZ8s= ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T16:33:35.080 INFO:teuthology.orchestra.run.smithi094.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sU8MNlEVKZL9OANyUzidheqf/k4EmJyX+S86okxZ63nZuFsEoCiwGIGSUlhbJ4dEZVCB7HfPRfrhbC1d15qLGYsjejb2opd/ZwYeXFYRvyexAxjAbLXQh6ZXf5DlfyLQFB+GQWJ3O7kUg7Yq3xNg4qXoX6/eZRsp1pTa82Zi3p4jTHX8wMkKjTMv8qqvNgcUA5Kt7QieE4HcAxX2JBOjqyEYw6qEh3VuqW8IlueflL94Ng4dVEvLR1TSh5HZulto1bLADqYi2xtV/6dwYpvmYDv/zJDuGSlkf5JQWKPMdFSWpAAR2WzGeYA0diBO735Olkdss8+IoFdmFkXvvObniq7CpXSPH8AHmMXt5nBt1I1lTMvWo3OfDKdl6bctnhh8gLL50AEDw9RPn6iohmf5/k4jLGLKlde+tbTprtvlWcgNIDljE9MsN5RUY2b/Y1wFHDM6F7KtFvLQplPQNsGV7VBdp66d9gWT4ixwHDLSELQcYztgJ4rerqcStS5OZ8s= ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:33:35.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sU8MNlEVKZL9OANyUzidheqf/k4EmJyX+S86okxZ63nZuFsEoCiwGIGSUlhbJ4dEZVCB7HfPRfrhbC1d15qLGYsjejb2opd/ZwYeXFYRvyexAxjAbLXQh6ZXf5DlfyLQFB+GQWJ3O7kUg7Yq3xNg4qXoX6/eZRsp1pTa82Zi3p4jTHX8wMkKjTMv8qqvNgcUA5Kt7QieE4HcAxX2JBOjqyEYw6qEh3VuqW8IlueflL94Ng4dVEvLR1TSh5HZulto1bLADqYi2xtV/6dwYpvmYDv/zJDuGSlkf5JQWKPMdFSWpAAR2WzGeYA0diBO735Olkdss8+IoFdmFkXvvObniq7CpXSPH8AHmMXt5nBt1I1lTMvWo3OfDKdl6bctnhh8gLL50AEDw9RPn6iohmf5/k4jLGLKlde+tbTprtvlWcgNIDljE9MsN5RUY2b/Y1wFHDM6F7KtFvLQplPQNsGV7VBdp66d9gWT4ixwHDLSELQcYztgJ4rerqcStS5OZ8s= ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-27T16:33:35.115 INFO:teuthology.orchestra.run.smithi106.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9sU8MNlEVKZL9OANyUzidheqf/k4EmJyX+S86okxZ63nZuFsEoCiwGIGSUlhbJ4dEZVCB7HfPRfrhbC1d15qLGYsjejb2opd/ZwYeXFYRvyexAxjAbLXQh6ZXf5DlfyLQFB+GQWJ3O7kUg7Yq3xNg4qXoX6/eZRsp1pTa82Zi3p4jTHX8wMkKjTMv8qqvNgcUA5Kt7QieE4HcAxX2JBOjqyEYw6qEh3VuqW8IlueflL94Ng4dVEvLR1TSh5HZulto1bLADqYi2xtV/6dwYpvmYDv/zJDuGSlkf5JQWKPMdFSWpAAR2WzGeYA0diBO735Olkdss8+IoFdmFkXvvObniq7CpXSPH8AHmMXt5nBt1I1lTMvWo3OfDKdl6bctnhh8gLL50AEDw9RPn6iohmf5/k4jLGLKlde+tbTprtvlWcgNIDljE9MsN5RUY2b/Y1wFHDM6F7KtFvLQplPQNsGV7VBdp66d9gWT4ixwHDLSELQcYztgJ4rerqcStS5OZ8s= ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:33:35.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-01-27T16:33:39.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:38 smithi106 bash[9795]: audit 2021-01-27T16:33:38.883233+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:33:40.404 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi094 2021-01-27T16:33:40.405 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:33:40.405 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.conf 2021-01-27T16:33:40.412 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:33:40.413 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T16:33:40.462 INFO:tasks.cephadm:Adding host smithi094 to orchestrator... 2021-01-27T16:33:40.463 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch host add smithi094 2021-01-27T16:33:40.528 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.254756+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:40.528 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: cephadm 2021-01-27T16:33:39.255407+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:33:40.528 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.307710+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.106:0/436565613' entity='client.admin' 2021-01-27T16:33:40.528 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.858048+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:40.529 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.859470+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:33:40.529 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.861115+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:33:40.529 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:40 smithi106 bash[9795]: audit 2021-01-27T16:33:39.863687+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:33:41.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:41 smithi106 bash[9795]: cephadm 2021-01-27T16:33:39.858803+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-01-27T16:33:41.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:41 smithi106 bash[9795]: cephadm 2021-01-27T16:33:39.862451+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi106 2021-01-27T16:33:46.045 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: audit 2021-01-27T16:33:44.758439+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:46.046 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: cephadm 2021-01-27T16:33:44.759271+0000 mgr.y (mgr.14138) 8 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-01-27T16:33:46.047 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: audit 2021-01-27T16:33:44.759775+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T16:33:46.047 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: audit 2021-01-27T16:33:44.761386+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:33:46.047 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: cephadm 2021-01-27T16:33:44.762812+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring daemon mgr.y on smithi106 2021-01-27T16:33:46.048 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: audit 2021-01-27T16:33:44.763996+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T16:33:46.048 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:45 smithi106 bash[9795]: cluster 2021-01-27T16:33:45.278465+0000 mgr.y (mgr.14138) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:48.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:47 smithi106 bash[9795]: audit 2021-01-27T16:33:46.806680+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:48.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:47 smithi106 bash[9795]: audit 2021-01-27T16:33:46.809610+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:33:48.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:47 smithi106 bash[9795]: cluster 2021-01-27T16:33:47.278875+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:48.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:47 smithi106 bash[9795]: audit 2021-01-27T16:33:47.548820+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:48.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:47 smithi106 bash[9795]: audit 2021-01-27T16:33:47.554376+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:33:50.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:50 smithi106 bash[9795]: cluster 2021-01-27T16:33:49.279292+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:52.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:52 smithi106 bash[9795]: cluster 2021-01-27T16:33:51.279697+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:54.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:54 smithi106 bash[9795]: cluster 2021-01-27T16:33:53.280116+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:56.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:56 smithi106 bash[9795]: cluster 2021-01-27T16:33:55.280515+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:33:58.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:33:57 smithi106 bash[9795]: cluster 2021-01-27T16:33:57.280927+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:00.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:00 smithi106 bash[9795]: cluster 2021-01-27T16:33:59.281313+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:02.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:02 smithi106 bash[9795]: cluster 2021-01-27T16:34:01.281702+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:04.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:04 smithi106 bash[9795]: cluster 2021-01-27T16:34:03.282109+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:06.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:06 smithi106 bash[9795]: cluster 2021-01-27T16:34:05.282500+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:08.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:07 smithi106 bash[9795]: cluster 2021-01-27T16:34:07.282910+0000 mgr.y (mgr.14138) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:08.701 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:34:08 smithi106 bash[10032]: Warning: Permanently added 'smithi094,172.21.15.94' (ECDSA) to the list of known hosts. 2021-01-27T16:34:09.144 INFO:teuthology.orchestra.run.smithi094.stdout:Added host 'smithi094' 2021-01-27T16:34:09.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:08 smithi106 bash[9795]: audit 2021-01-27T16:34:08.313821+0000 mgr.y (mgr.14138) 22 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi094", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:34:10.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch host ls --format=json 2021-01-27T16:34:10.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.142093+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:10.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: cephadm 2021-01-27T16:34:09.143019+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi094 2021-01-27T16:34:10.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.147254+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:10.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: cluster 2021-01-27T16:34:09.283352+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:10.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.575164+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:10.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.576511+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:10.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.853049+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:10.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.923490+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:10.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:10 smithi106 bash[9795]: audit 2021-01-27T16:34:09.925038+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:34:12.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:12 smithi106 bash[9795]: cluster 2021-01-27T16:34:11.283788+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:14 smithi106 bash[9795]: cluster 2021-01-27T16:34:13.284217+0000 mgr.y (mgr.14138) 26 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:14.941 INFO:teuthology.orchestra.run.smithi094.stdout: 2021-01-27T16:34:14.942 INFO:teuthology.orchestra.run.smithi094.stdout:[{"addr": "smithi106", "hostname": "smithi106", "labels": [], "status": ""}, {"addr": "smithi094", "hostname": "smithi094", "labels": [], "status": ""}] 2021-01-27T16:34:15.761 INFO:tasks.cephadm:Setting crush tunables to default 2021-01-27T16:34:15.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd crush tunables default 2021-01-27T16:34:16.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:16 smithi106 bash[9795]: audit 2021-01-27T16:34:14.941171+0000 mgr.y (mgr.14138) 27 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:34:16.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:16 smithi106 bash[9795]: cluster 2021-01-27T16:34:15.284614+0000 mgr.y (mgr.14138) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:18.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:17 smithi106 bash[9795]: audit 2021-01-27T16:34:17.115764+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:18.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:17 smithi106 bash[9795]: cluster 2021-01-27T16:34:17.285069+0000 mgr.y (mgr.14138) 29 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:18.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:17 smithi106 bash[9795]: audit 2021-01-27T16:34:17.482534+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:19.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:18 smithi106 bash[9795]: cephadm 2021-01-27T16:34:17.483583+0000 mgr.y (mgr.14138) 30 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:34:19.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:18 smithi106 bash[9795]: audit 2021-01-27T16:34:17.929735+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:19.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:18 smithi106 bash[9795]: audit 2021-01-27T16:34:17.935395+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:19.945 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2021-01-27T16:34:20.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:19 smithi106 bash[9795]: audit 2021-01-27T16:34:19.027700+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.106:0/2935542058' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-01-27T16:34:20.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:19 smithi106 bash[9795]: cluster 2021-01-27T16:34:19.285506+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:20.647 INFO:tasks.cephadm:Adding mon.c on smithi106 2021-01-27T16:34:20.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon 'smithi106:[v2:172.21.15.106:3301,v1:172.21.15.106:6790]=c' 2021-01-27T16:34:21.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:20 smithi106 bash[9795]: audit 2021-01-27T16:34:19.942394+0000 mon.a (mon.0) 125 : audit [INF] from='client.? 172.21.15.106:0/2935542058' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-01-27T16:34:21.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:20 smithi106 bash[9795]: cluster 2021-01-27T16:34:19.942529+0000 mon.a (mon.0) 126 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-01-27T16:34:21.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:20 smithi106 bash[9795]: audit 2021-01-27T16:34:19.943069+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-01-27T16:34:22.091 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:21 smithi106 bash[9795]: audit 2021-01-27T16:34:20.946699+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-01-27T16:34:22.091 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:21 smithi106 bash[9795]: cluster 2021-01-27T16:34:20.946859+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-01-27T16:34:22.092 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:21 smithi106 bash[9795]: audit 2021-01-27T16:34:20.948348+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-01-27T16:34:22.092 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:21 smithi106 bash[9795]: cluster 2021-01-27T16:34:21.285961+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:23.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:22 smithi106 bash[9795]: audit 2021-01-27T16:34:21.954525+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-01-27T16:34:23.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:22 smithi106 bash[9795]: cluster 2021-01-27T16:34:21.954700+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:24.249 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:23 smithi106 bash[9795]: cluster 2021-01-27T16:34:23.286521+0000 mgr.y (mgr.14138) 33 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:24.249 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:23 smithi106 bash[9795]: audit 2021-01-27T16:34:23.848517+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:24.249 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:23 smithi106 bash[9795]: audit 2021-01-27T16:34:23.850241+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:24.249 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:23 smithi106 bash[9795]: audit 2021-01-27T16:34:23.852438+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T16:34:25.277 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:24 smithi106 bash[9795]: audit 2021-01-27T16:34:23.844038+0000 mgr.y (mgr.14138) 34 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi106:[v2:172.21.15.106:3301,v1:172.21.15.106:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:34:25.277 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:24 smithi106 bash[9795]: cephadm 2021-01-27T16:34:23.851532+0000 mgr.y (mgr.14138) 35 : cephadm [INF] Deploying daemon mon.c on smithi106 2021-01-27T16:34:26.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:25 smithi106 bash[9795]: cluster 2021-01-27T16:34:25.286943+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:26.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:25 smithi106 bash[9795]: audit 2021-01-27T16:34:25.468357+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:34:26.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:25 smithi106 bash[9795]: audit 2021-01-27T16:34:25.471076+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:34:28.174 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:27 smithi106 bash[9795]: cluster 2021-01-27T16:34:27.287400+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:28.395 INFO:teuthology.orchestra.run.smithi106.stdout:Deployed mon.c on host 'smithi106' 2021-01-27T16:34:29.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:29 smithi106 bash[9795]: audit 2021-01-27T16:34:28.394340+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:29.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:29 smithi106 bash[9795]: audit 2021-01-27T16:34:28.397010+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:29.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:29 smithi106 bash[9795]: audit 2021-01-27T16:34:29.217478+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:29.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:29 smithi106 bash[9795]: audit 2021-01-27T16:34:29.224704+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:29.866 DEBUG:teuthology.orchestra.run.smithi106:mon.c> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.c.service 2021-01-27T16:34:29.869 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-01-27T16:34:29.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T16:34:29.898 INFO:journalctl@ceph.mon.c.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:34:30.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.069+0000 7f84d476c700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T16:34:30.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.069+0000 7f84d476c700 0 ceph version 17.0.0-142-g9f8421bb (9f8421bb8d39043f85c071a52714801b60d36be5) pacific (dev), process ceph-mon, pid 1 2021-01-27T16:34:30.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.069+0000 7f84d476c700 0 pidfile_write: ignore empty --pid-file 2021-01-27T16:34:30.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 0 load: jerasure load: lrc load: isa 2021-01-27T16:34:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T16:34:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T16:34:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T16:34:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: DB SUMMARY 2021-01-27T16:34:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T16:34:30.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T16:34:30.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T16:34:30.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-01-27T16:34:30.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-01-27T16:34:30.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T16:34:30.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T16:34:30.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T16:34:30.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.env: 0x55d28fad31c0 2021-01-27T16:34:30.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.fs: Posix File System 2021-01-27T16:34:30.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.info_log: 0x55d291ca9e80 2021-01-27T16:34:30.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T16:34:30.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.statistics: (nil) 2021-01-27T16:34:30.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.use_fsync: 0 2021-01-27T16:34:30.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T16:34:30.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T16:34:30.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T16:34:30.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T16:34:30.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T16:34:30.209 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T16:34:30.209 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T16:34:30.209 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T16:34:30.210 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T16:34:30.210 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T16:34:30.210 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T16:34:30.210 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.db_log_dir: 2021-01-27T16:34:30.210 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-01-27T16:34:30.211 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T16:34:30.211 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T16:34:30.211 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T16:34:30.211 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T16:34:30.211 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T16:34:30.212 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T16:34:30.212 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T16:34:30.212 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T16:34:30.212 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T16:34:30.212 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T16:34:30.213 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.write_buffer_manager: 0x55d291d03c20 2021-01-27T16:34:30.213 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T16:34:30.213 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T16:34:30.213 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T16:34:30.213 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T16:34:30.214 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T16:34:30.214 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T16:34:30.214 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T16:34:30.214 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T16:34:30.214 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T16:34:30.215 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.unordered_write: 0 2021-01-27T16:34:30.215 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T16:34:30.215 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T16:34:30.215 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T16:34:30.215 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T16:34:30.216 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.row_cache: None 2021-01-27T16:34:30.216 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.wal_filter: None 2021-01-27T16:34:30.216 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T16:34:30.216 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T16:34:30.216 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T16:34:30.217 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T16:34:30.217 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T16:34:30.217 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T16:34:30.217 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T16:34:30.217 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T16:34:30.218 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T16:34:30.218 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T16:34:30.218 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T16:34:30.218 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T16:34:30.218 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T16:34:30.219 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T16:34:30.219 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T16:34:30.219 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T16:34:30.219 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T16:34:30.220 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T16:34:30.220 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T16:34:30.220 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T16:34:30.220 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T16:34:30.220 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_open_files: -1 2021-01-27T16:34:30.221 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T16:34:30.221 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T16:34:30.221 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T16:34:30.221 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T16:34:30.221 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Compression algorithms supported: 2021-01-27T16:34:30.222 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T16:34:30.222 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kZSTD supported: 0 2021-01-27T16:34:30.222 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T16:34:30.222 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T16:34:30.222 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T16:34:30.223 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T16:34:30.223 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T16:34:30.223 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T16:34:30.223 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T16:34:30.223 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-01-27T16:34:30.224 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T16:34:30.224 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T16:34:30.224 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.merge_operator: 2021-01-27T16:34:30.224 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_filter: None 2021-01-27T16:34:30.224 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T16:34:30.225 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T16:34:30.225 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T16:34:30.225 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d291c521e0) 2021-01-27T16:34:30.225 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: cache_index_and_filter_blocks: 1 2021-01-27T16:34:30.225 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T16:34:30.226 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T16:34:30.226 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: pin_top_level_index_and_filter: 1 2021-01-27T16:34:30.226 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: index_type: 0 2021-01-27T16:34:30.226 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: data_block_index_type: 0 2021-01-27T16:34:30.226 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: index_shortening: 1 2021-01-27T16:34:30.227 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T16:34:30.227 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: hash_index_allow_collision: 1 2021-01-27T16:34:30.227 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: checksum: 1 2021-01-27T16:34:30.227 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: no_block_cache: 0 2021-01-27T16:34:30.227 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_cache: 0x55d291c8a510 2021-01-27T16:34:30.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_cache_name: BinnedLRUCache 2021-01-27T16:34:30.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_cache_options: 2021-01-27T16:34:30.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: capacity : 536870912 2021-01-27T16:34:30.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: num_shard_bits : 4 2021-01-27T16:34:30.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: strict_capacity_limit : 0 2021-01-27T16:34:30.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: high_pri_pool_ratio: 0.000 2021-01-27T16:34:30.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_cache_compressed: (nil) 2021-01-27T16:34:30.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: persistent_cache: (nil) 2021-01-27T16:34:30.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_size: 4096 2021-01-27T16:34:30.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_size_deviation: 10 2021-01-27T16:34:30.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_restart_interval: 16 2021-01-27T16:34:30.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: index_block_restart_interval: 1 2021-01-27T16:34:30.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: metadata_block_size: 4096 2021-01-27T16:34:30.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: partition_filters: 0 2021-01-27T16:34:30.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: use_delta_encoding: 1 2021-01-27T16:34:30.231 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T16:34:30.231 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: whole_key_filtering: 1 2021-01-27T16:34:30.231 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: verify_compression: 0 2021-01-27T16:34:30.231 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: read_amp_bytes_per_bit: 0 2021-01-27T16:34:30.231 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: format_version: 2 2021-01-27T16:34:30.232 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: enable_index_compression: 1 2021-01-27T16:34:30.232 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: block_align: 0 2021-01-27T16:34:30.232 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T16:34:30.232 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T16:34:30.232 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression: NoCompression 2021-01-27T16:34:30.233 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T16:34:30.233 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T16:34:30.233 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T16:34:30.233 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.num_levels: 7 2021-01-27T16:34:30.233 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T16:34:30.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T16:34:30.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T16:34:30.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T16:34:30.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T16:34:30.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T16:34:30.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T16:34:30.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:34:30.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T16:34:30.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T16:34:30.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T16:34:30.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T16:34:30.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T16:34:30.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:34:30.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T16:34:30.237 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T16:34:30.237 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T16:34:30.237 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T16:34:30.237 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T16:34:30.237 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T16:34:30.238 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T16:34:30.238 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T16:34:30.238 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T16:34:30.238 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T16:34:30.238 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T16:34:30.239 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T16:34:30.239 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T16:34:30.239 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T16:34:30.239 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T16:34:30.240 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T16:34:30.240 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T16:34:30.240 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T16:34:30.240 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T16:34:30.240 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T16:34:30.241 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T16:34:30.241 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T16:34:30.241 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T16:34:30.241 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T16:34:30.242 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T16:34:30.242 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T16:34:30.242 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T16:34:30.242 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T16:34:30.243 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T16:34:30.243 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T16:34:30.243 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T16:34:30.243 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T16:34:30.243 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T16:34:30.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T16:34:30.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T16:34:30.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T16:34:30.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T16:34:30.245 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T16:34:30.245 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T16:34:30.245 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T16:34:30.245 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T16:34:30.246 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T16:34:30.246 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T16:34:30.246 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T16:34:30.246 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T16:34:30.246 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.ttl: 2592000 2021-01-27T16:34:30.247 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T16:34:30.247 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T16:34:30.247 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.077+0000 7f84d476c700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T16:34:30.247 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765270083350, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T16:34:30.248 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T16:34:30.248 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T16:34:30.248 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765270084153, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611765270, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T16:34:30.248 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T16:34:30.248 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.081+0000 7f84d476c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765270084627, "job": 1, "event": "recovery_finished"} 2021-01-27T16:34:30.249 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84d476c700 4 rocksdb: DB pointer 0x55d291d49800 2021-01-27T16:34:30.249 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84bb58d700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T16:34:30.249 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84bb58d700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T16:34:30.249 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** DB Stats ** 2021-01-27T16:34:30.249 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:30.250 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T16:34:30.250 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T16:34:30.250 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:34:30.250 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T16:34:30.250 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T16:34:30.251 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:34:30.251 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** Compaction Stats [default] ** 2021-01-27T16:34:30.251 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:30.251 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:30.251 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.252 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.252 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.252 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** Compaction Stats [default] ** 2021-01-27T16:34:30.252 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:30.252 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:30.253 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.253 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:30.253 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:30.253 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:30.253 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:34:30.254 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:34:30.254 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:34:30.254 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Cumulative compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:30.254 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Interval compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:30.255 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:34:30.255 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:34:30.255 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** Compaction Stats [default] ** 2021-01-27T16:34:30.255 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:30.255 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:30.256 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.256 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.256 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:34:30.256 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** Compaction Stats [default] ** 2021-01-27T16:34:30.256 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:30.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:30.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2021-01-27T16:34:30.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:30.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:30.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:30.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:34:30.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:34:30.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:34:30.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Cumulative compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:30.259 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:30.259 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:34:30.259 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:34:30.259 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84d476c700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-01-27T16:34:30.259 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84d476c700 0 using public_addrv [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] 2021-01-27T16:34:30.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84d476c700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] at bind addrs [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:30.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.085+0000 7f84d476c700 1 mon.c@-1(???) e0 preinit fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:30.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).mds e1 new map 2021-01-27T16:34:30.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-01-27T16:34:30.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: e1 2021-01-27T16:34:30.261 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T16:34:30.261 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T16:34:30.261 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: legacy client fscid: -1 2021-01-27T16:34:30.261 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: 2021-01-27T16:34:30.261 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: No filesystems configured 2021-01-27T16:34:30.262 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T16:34:30.262 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T16:34:30.262 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T16:34:30.262 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T16:34:30.263 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T16:34:30.263 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T16:34:30.263 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T16:34:30.263 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T16:34:30.263 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T16:34:30.264 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:30.264 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:30.264 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:30.264 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: audit 2021-01-27T16:34:28.394340+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:30.264 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: audit 2021-01-27T16:34:28.397010+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:30.265 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: audit 2021-01-27T16:34:29.217478+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:30.265 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: audit 2021-01-27T16:34:29.224704+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:30.265 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.109+0000 7f84bdd92700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-01-27T16:34:30.265 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expand map: {default=false} 2021-01-27T16:34:30.266 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T16:34:30.266 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T16:34:30.266 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expand map: {default=info} 2021-01-27T16:34:30.266 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T16:34:30.266 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T16:34:30.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T16:34:30.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T16:34:30.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T16:34:30.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T16:34:30.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T16:34:30.268 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T16:34:30.268 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:30 smithi106 bash[13484]: debug 2021-01-27T16:34:30.113+0000 7f84bdd92700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-01-27T16:34:35.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:30.123617+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T16:34:35.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: audit 2021-01-27T16:34:31.118963+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:31.288271+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:35.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: audit 2021-01-27T16:34:32.118832+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:32.121030+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T16:34:35.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: audit 2021-01-27T16:34:33.118902+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:33.288736+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:35.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: audit 2021-01-27T16:34:34.119252+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: audit 2021-01-27T16:34:35.119289+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.144886+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T16:34:35.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.151087+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0]} 2021-01-27T16:34:35.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.151190+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T16:34:35.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.151257+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:35.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.151890+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 69s) 2021-01-27T16:34:35.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.158313+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T16:34:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:30.123617+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-27T16:34:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: audit 2021-01-27T16:34:31.118963+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:31.288271+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: audit 2021-01-27T16:34:32.118832+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:32.121030+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-27T16:34:35.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: audit 2021-01-27T16:34:33.118902+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:33.288736+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:35.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: audit 2021-01-27T16:34:34.119252+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: audit 2021-01-27T16:34:35.119289+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:35.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.144886+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-27T16:34:35.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.151087+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],c=[v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0]} 2021-01-27T16:34:35.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.151190+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-27T16:34:35.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.151257+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:35.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.151890+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 69s) 2021-01-27T16:34:35.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:35 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.158313+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-27T16:34:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:34:36.423 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"fsid":"294bdd66-60bd-11eb-8f9a-001a4aab830c","modified":"2021-01-27T16:34:30.119297Z","created":"2021-01-27T16:32:24.495275Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3301","nonce":0},{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-27T16:34:36.426 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 2 2021-01-27T16:34:36.474 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:36 smithi106 bash[13484]: cluster 2021-01-27T16:34:35.289215+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:36.475 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:36 smithi106 bash[13484]: audit 2021-01-27T16:34:36.119702+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:36.475 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:36 smithi106 bash[9795]: cluster 2021-01-27T16:34:35.289215+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:36.475 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:36 smithi106 bash[9795]: audit 2021-01-27T16:34:36.119702+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-27T16:34:37.177 INFO:tasks.cephadm:Adding mon.b on smithi094 2021-01-27T16:34:37.177 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add mon smithi094:172.21.15.94=b 2021-01-27T16:34:37.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:37 smithi106 bash[9795]: audit 2021-01-27T16:34:36.425502+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.106:0/388868446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:34:37.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:37 smithi106 bash[13484]: audit 2021-01-27T16:34:36.425502+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.106:0/388868446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:34:38.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:38 smithi106 bash[9795]: cluster 2021-01-27T16:34:37.289737+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:38.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:38 smithi106 bash[13484]: cluster 2021-01-27T16:34:37.289737+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:40.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:40 smithi106 bash[9795]: cluster 2021-01-27T16:34:39.290205+0000 mgr.y (mgr.14138) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:40.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:40 smithi106 bash[13484]: cluster 2021-01-27T16:34:39.290205+0000 mgr.y (mgr.14138) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:41.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[9795]: audit 2021-01-27T16:34:40.634890+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:41.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[9795]: audit 2021-01-27T16:34:40.637037+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:41.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[9795]: audit 2021-01-27T16:34:40.639270+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T16:34:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[13484]: audit 2021-01-27T16:34:40.634890+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[13484]: audit 2021-01-27T16:34:40.637037+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:41 smithi106 bash[13484]: audit 2021-01-27T16:34:40.639270+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T16:34:42.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[9795]: audit 2021-01-27T16:34:40.631975+0000 mgr.y (mgr.14138) 44 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi094:172.21.15.94=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:34:42.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[9795]: cephadm 2021-01-27T16:34:40.638368+0000 mgr.y (mgr.14138) 45 : cephadm [INF] Deploying daemon mon.b on smithi094 2021-01-27T16:34:42.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[9795]: cluster 2021-01-27T16:34:41.290660+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:42.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[13484]: audit 2021-01-27T16:34:40.631975+0000 mgr.y (mgr.14138) 44 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi094:172.21.15.94=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:34:42.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[13484]: cephadm 2021-01-27T16:34:40.638368+0000 mgr.y (mgr.14138) 45 : cephadm [INF] Deploying daemon mon.b on smithi094 2021-01-27T16:34:42.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:42 smithi106 bash[13484]: cluster 2021-01-27T16:34:41.290660+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:44.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:44 smithi106 bash[9795]: cluster 2021-01-27T16:34:43.291110+0000 mgr.y (mgr.14138) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:44.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:44 smithi106 bash[13484]: cluster 2021-01-27T16:34:43.291110+0000 mgr.y (mgr.14138) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:45.995 INFO:teuthology.orchestra.run.smithi094.stdout:Deployed mon.b on host 'smithi094' 2021-01-27T16:34:46.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[9795]: cluster 2021-01-27T16:34:45.291560+0000 mgr.y (mgr.14138) 48 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:46.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[9795]: audit 2021-01-27T16:34:45.987497+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:46.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[9795]: audit 2021-01-27T16:34:45.991935+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:46.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[13484]: cluster 2021-01-27T16:34:45.291560+0000 mgr.y (mgr.14138) 48 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:46.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[13484]: audit 2021-01-27T16:34:45.987497+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:34:46.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:46 smithi106 bash[13484]: audit 2021-01-27T16:34:45.991935+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:47.514 DEBUG:teuthology.orchestra.run.smithi094:mon.b> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mon.b.service 2021-01-27T16:34:47.516 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-01-27T16:34:47.517 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph mon dump -f json 2021-01-27T16:34:47.596 INFO:journalctl@ceph.mon.b.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:34:47.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: cephadm 2021-01-27T16:34:45.986221+0000 mgr.y (mgr.14138) 49 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:34:47.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: audit 2021-01-27T16:34:46.722242+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:47.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: audit 2021-01-27T16:34:46.729045+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:47.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: audit 2021-01-27T16:34:46.730184+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:47.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: audit 2021-01-27T16:34:46.731318+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:47.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[9795]: audit 2021-01-27T16:34:46.733087+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:34:47.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: cephadm 2021-01-27T16:34:45.986221+0000 mgr.y (mgr.14138) 49 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:34:47.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: audit 2021-01-27T16:34:46.722242+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:47.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: audit 2021-01-27T16:34:46.729045+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:47.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: audit 2021-01-27T16:34:46.730184+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:47.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: audit 2021-01-27T16:34:46.731318+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:47.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:47 smithi106 bash[13484]: audit 2021-01-27T16:34:46.733087+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:34:47.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.755+0000 7f44a0a4b700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-27T16:34:47.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.755+0000 7f44a0a4b700 0 ceph version 17.0.0-142-g9f8421bb (9f8421bb8d39043f85c071a52714801b60d36be5) pacific (dev), process ceph-mon, pid 1 2021-01-27T16:34:47.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.755+0000 7f44a0a4b700 0 pidfile_write: ignore empty --pid-file 2021-01-27T16:34:48.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 0 load: jerasure load: lrc load: isa 2021-01-27T16:34:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: RocksDB version: 6.8.1 2021-01-27T16:34:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-27T16:34:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Compile date Jan 27 2021 2021-01-27T16:34:48.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: DB SUMMARY 2021-01-27T16:34:48.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: CURRENT file: CURRENT 2021-01-27T16:34:48.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-27T16:34:48.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-27T16:34:48.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-01-27T16:34:48.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 636 ; 2021-01-27T16:34:48.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.error_if_exists: 0 2021-01-27T16:34:48.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.create_if_missing: 0 2021-01-27T16:34:48.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.paranoid_checks: 1 2021-01-27T16:34:48.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.env: 0x55a3b30491c0 2021-01-27T16:34:48.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.fs: Posix File System 2021-01-27T16:34:48.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.info_log: 0x55a3b55efe80 2021-01-27T16:34:48.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-27T16:34:48.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.statistics: (nil) 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.use_fsync: 0 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_log_file_size: 0 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-27T16:34:48.040 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-27T16:34:48.041 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.allow_fallocate: 1 2021-01-27T16:34:48.041 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-27T16:34:48.041 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-27T16:34:48.041 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.use_direct_reads: 0 2021-01-27T16:34:48.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-27T16:34:48.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-27T16:34:48.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.db_log_dir: 2021-01-27T16:34:48.043 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-01-27T16:34:48.044 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-27T16:34:48.044 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_subcompactions: 1 2021-01-27T16:34:48.044 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_background_flushes: -1 2021-01-27T16:34:48.044 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-27T16:34:48.044 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-27T16:34:48.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-27T16:34:48.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-27T16:34:48.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-27T16:34:48.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-27T16:34:48.045 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-27T16:34:48.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.write_buffer_manager: 0x55a3b5649bf0 2021-01-27T16:34:48.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-27T16:34:48.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-27T16:34:48.046 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-27T16:34:48.047 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-27T16:34:48.047 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-27T16:34:48.047 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-27T16:34:48.047 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-27T16:34:48.047 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-27T16:34:48.048 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-27T16:34:48.048 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.unordered_write: 0 2021-01-27T16:34:48.048 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-27T16:34:48.048 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-27T16:34:48.048 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-27T16:34:48.049 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-27T16:34:48.049 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.row_cache: None 2021-01-27T16:34:48.049 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.wal_filter: None 2021-01-27T16:34:48.049 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-27T16:34:48.049 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-27T16:34:48.050 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.preserve_deletes: 0 2021-01-27T16:34:48.050 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.two_write_queues: 0 2021-01-27T16:34:48.050 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-27T16:34:48.050 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.atomic_flush: 0 2021-01-27T16:34:48.050 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-27T16:34:48.051 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-27T16:34:48.051 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-27T16:34:48.051 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.log_readahead_size: 0 2021-01-27T16:34:48.051 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-27T16:34:48.051 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_background_jobs: 2 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_background_compactions: -1 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-27T16:34:48.052 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-27T16:34:48.053 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-27T16:34:48.053 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-27T16:34:48.053 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-27T16:34:48.053 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_open_files: -1 2021-01-27T16:34:48.053 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-27T16:34:48.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-27T16:34:48.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-27T16:34:48.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-27T16:34:48.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Compression algorithms supported: 2021-01-27T16:34:48.054 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-27T16:34:48.055 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kZSTD supported: 0 2021-01-27T16:34:48.055 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kXpressCompression supported: 0 2021-01-27T16:34:48.055 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-27T16:34:48.055 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kLZ4Compression supported: 1 2021-01-27T16:34:48.055 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kBZip2Compression supported: 0 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kZlibCompression supported: 1 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: kSnappyCompression supported: 1 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-27T16:34:48.056 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-27T16:34:48.057 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.merge_operator: 2021-01-27T16:34:48.057 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_filter: None 2021-01-27T16:34:48.057 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-27T16:34:48.057 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-27T16:34:48.057 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-27T16:34:48.058 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a3b55981e0) 2021-01-27T16:34:48.058 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: cache_index_and_filter_blocks: 1 2021-01-27T16:34:48.058 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-27T16:34:48.058 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-27T16:34:48.058 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: pin_top_level_index_and_filter: 1 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: index_type: 0 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: data_block_index_type: 0 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: index_shortening: 1 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: data_block_hash_table_util_ratio: 0.750000 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: hash_index_allow_collision: 1 2021-01-27T16:34:48.059 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: checksum: 1 2021-01-27T16:34:48.060 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: no_block_cache: 0 2021-01-27T16:34:48.060 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_cache: 0x55a3b55d0510 2021-01-27T16:34:48.060 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_cache_name: BinnedLRUCache 2021-01-27T16:34:48.060 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_cache_options: 2021-01-27T16:34:48.060 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: capacity : 536870912 2021-01-27T16:34:48.061 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: num_shard_bits : 4 2021-01-27T16:34:48.061 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: strict_capacity_limit : 0 2021-01-27T16:34:48.061 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: high_pri_pool_ratio: 0.000 2021-01-27T16:34:48.061 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_cache_compressed: (nil) 2021-01-27T16:34:48.061 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: persistent_cache: (nil) 2021-01-27T16:34:48.062 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_size: 4096 2021-01-27T16:34:48.062 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_size_deviation: 10 2021-01-27T16:34:48.062 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_restart_interval: 16 2021-01-27T16:34:48.062 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: index_block_restart_interval: 1 2021-01-27T16:34:48.062 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: metadata_block_size: 4096 2021-01-27T16:34:48.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: partition_filters: 0 2021-01-27T16:34:48.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: use_delta_encoding: 1 2021-01-27T16:34:48.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-27T16:34:48.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: whole_key_filtering: 1 2021-01-27T16:34:48.063 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: verify_compression: 0 2021-01-27T16:34:48.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: read_amp_bytes_per_bit: 0 2021-01-27T16:34:48.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: format_version: 2 2021-01-27T16:34:48.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: enable_index_compression: 1 2021-01-27T16:34:48.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: block_align: 0 2021-01-27T16:34:48.064 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression: NoCompression 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-27T16:34:48.065 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.num_levels: 7 2021-01-27T16:34:48.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-27T16:34:48.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-27T16:34:48.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-27T16:34:48.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-27T16:34:48.066 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-27T16:34:48.067 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-27T16:34:48.067 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-27T16:34:48.067 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:34:48.067 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-27T16:34:48.067 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-27T16:34:48.068 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-27T16:34:48.068 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-27T16:34:48.068 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-27T16:34:48.068 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-27T16:34:48.069 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-27T16:34:48.069 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-27T16:34:48.069 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-27T16:34:48.069 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-27T16:34:48.069 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-27T16:34:48.070 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-27T16:34:48.070 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-27T16:34:48.070 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-27T16:34:48.070 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-27T16:34:48.070 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-27T16:34:48.071 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-27T16:34:48.071 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-27T16:34:48.071 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-27T16:34:48.071 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-27T16:34:48.071 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-27T16:34:48.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-27T16:34:48.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-27T16:34:48.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-27T16:34:48.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-27T16:34:48.072 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-27T16:34:48.073 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-27T16:34:48.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-27T16:34:48.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-27T16:34:48.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-27T16:34:48.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-27T16:34:48.074 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-27T16:34:48.075 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-27T16:34:48.075 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-27T16:34:48.075 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.table_properties_collectors: 2021-01-27T16:34:48.075 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.inplace_update_support: 0 2021-01-27T16:34:48.075 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-27T16:34:48.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-27T16:34:48.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-27T16:34:48.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-27T16:34:48.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.bloom_locality: 0 2021-01-27T16:34:48.076 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.max_successive_merges: 0 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.ttl: 2592000 2021-01-27T16:34:48.077 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-27T16:34:48.078 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-27T16:34:48.078 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-27T16:34:48.078 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765287768315, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-27T16:34:48.078 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765287768844, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611765287, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.763+0000 7f44a0a4b700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611765287769352, "job": 1, "event": "recovery_finished"} 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f44a0a4b700 4 rocksdb: DB pointer 0x55a3b568f800 2021-01-27T16:34:48.079 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f448786c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-27T16:34:48.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f448786c700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-27T16:34:48.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** DB Stats ** 2021-01-27T16:34:48.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:48.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-27T16:34:48.080 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-27T16:34:48.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:34:48.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-27T16:34:48.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-27T16:34:48.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-27T16:34:48.081 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** Compaction Stats [default] ** 2021-01-27T16:34:48.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:48.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:48.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.082 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.083 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** Compaction Stats [default] ** 2021-01-27T16:34:48.083 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:48.083 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:48.083 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.083 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:34:48.084 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:48.085 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:48.085 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:34:48.085 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:34:48.085 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** Compaction Stats [default] ** 2021-01-27T16:34:48.085 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:48.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:48.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-27T16:34:48.086 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** Compaction Stats [default] ** 2021-01-27T16:34:48.087 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-27T16:34:48.087 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-27T16:34:48.087 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2021-01-27T16:34:48.087 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-27T16:34:48.087 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:48.088 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-27T16:34:48.088 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(Total Files): cumulative 0, interval 0 2021-01-27T16:34:48.088 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-27T16:34:48.088 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: AddFile(Keys): cumulative 0, interval 0 2021-01-27T16:34:48.088 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:48.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-27T16:34:48.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-27T16:34:48.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: ** File Read Latency Histogram By Level [default] ** 2021-01-27T16:34:48.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f44a0a4b700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-01-27T16:34:48.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f44a0a4b700 0 using public_addr v2:172.21.15.94:0/0 -> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f44a0a4b700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] at bind addrs [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.767+0000 7f44a0a4b700 1 mon.b@-1(???) e0 preinit fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).mds e1 new map 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: e1 2021-01-27T16:34:48.090 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-27T16:34:48.091 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-27T16:34:48.091 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: legacy client fscid: -1 2021-01-27T16:34:48.091 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: 2021-01-27T16:34:48.091 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: No filesystems configured 2021-01-27T16:34:48.091 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-27T16:34:48.092 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-27T16:34:48.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-27T16:34:48.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-27T16:34:48.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:48.093 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:48.094 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-27T16:34:48.094 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: cephadm 2021-01-27T16:34:45.986221+0000 mgr.y (mgr.14138) 49 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:34:48.094 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: audit 2021-01-27T16:34:46.722242+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:48.094 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: audit 2021-01-27T16:34:46.729045+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:48.094 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: audit 2021-01-27T16:34:46.730184+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:48.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: audit 2021-01-27T16:34:46.731318+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:48.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: audit 2021-01-27T16:34:46.733087+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:34:48.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.799+0000 7f448a071700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-01-27T16:34:48.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expand map: {default=false} 2021-01-27T16:34:48.095 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta from 'false' to 'false' 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expanded map: {default=false} 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expand map: {default=info} 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta from 'info' to 'info' 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expanded map: {default=info} 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expand map: {default=daemon} 2021-01-27T16:34:48.096 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-27T16:34:48.097 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-27T16:34:48.097 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expand map: {default=debug} 2021-01-27T16:34:48.097 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-27T16:34:48.097 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 20 expand_channel_meta expanded map: {default=debug} 2021-01-27T16:34:48.097 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:47 smithi094 bash[9811]: debug 2021-01-27T16:34:47.803+0000 7f448a071700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-01-27T16:34:53.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:47.817864+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T16:34:53.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:47.819312+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T16:34:53.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:48.811201+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:49.292526+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:49.811289+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:49.813459+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T16:34:53.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:50.811283+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:51.293057+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:51.811385+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:52.811647+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.841113+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T16:34:53.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.847106+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0]} 2021-01-27T16:34:53.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.847216+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-27T16:34:53.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.847274+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:53.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.847666+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 87s) 2021-01-27T16:34:53.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: cluster 2021-01-27T16:34:52.854934+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-27T16:34:53.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:52.859070+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:53.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:52.860416+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T16:34:53.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:52.861735+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:53.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[13484]: audit 2021-01-27T16:34:52.863849+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T16:34:53.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:47.817864+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T16:34:53.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:47.819312+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T16:34:53.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:48.811201+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:49.292526+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:49.811289+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:49.813459+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T16:34:53.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:50.811283+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:51.293057+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:51.811385+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:52.811647+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.841113+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T16:34:53.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.847106+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0]} 2021-01-27T16:34:53.208 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.847216+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-27T16:34:53.208 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.847274+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:53.208 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.847666+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 87s) 2021-01-27T16:34:53.208 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: cluster 2021-01-27T16:34:52.854934+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-27T16:34:53.208 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:52.859070+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:53.209 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:52.860416+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T16:34:53.209 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:52.861735+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:53.209 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:52 smithi106 bash[9795]: audit 2021-01-27T16:34:52.863849+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T16:34:53.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:47.817864+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-27T16:34:53.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:47.819312+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-27T16:34:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:48.811201+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:49.292526+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:49.811289+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:49.813459+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-27T16:34:53.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:50.811283+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:51.293057+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:53.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:51.811385+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:52.811647+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:53.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.841113+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-27T16:34:53.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.847106+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0],b=[v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0],c=[v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0]} 2021-01-27T16:34:53.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.847216+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-27T16:34:53.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.847274+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-27T16:34:53.289 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.847666+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 87s) 2021-01-27T16:34:53.289 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: cluster 2021-01-27T16:34:52.854934+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-27T16:34:53.289 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:52.859070+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:53.289 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:52.860416+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-27T16:34:53.290 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:52.861735+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:53.290 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:52 smithi094 bash[9811]: audit 2021-01-27T16:34:52.863849+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-27T16:34:54.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[9795]: cephadm 2021-01-27T16:34:52.859961+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T16:34:54.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[9795]: cephadm 2021-01-27T16:34:52.862902+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi106 2021-01-27T16:34:54.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[9795]: cluster 2021-01-27T16:34:53.293509+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:54.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[9795]: audit 2021-01-27T16:34:53.811715+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:54.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[13484]: cephadm 2021-01-27T16:34:52.859961+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T16:34:54.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[13484]: cephadm 2021-01-27T16:34:52.862902+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi106 2021-01-27T16:34:54.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[13484]: cluster 2021-01-27T16:34:53.293509+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:54.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:53 smithi106 bash[13484]: audit 2021-01-27T16:34:53.811715+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:54.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:53 smithi094 bash[9811]: cephadm 2021-01-27T16:34:52.859961+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-27T16:34:54.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:53 smithi094 bash[9811]: cephadm 2021-01-27T16:34:52.862902+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi106 2021-01-27T16:34:54.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:53 smithi094 bash[9811]: cluster 2021-01-27T16:34:53.293509+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:54.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:53 smithi094 bash[9811]: audit 2021-01-27T16:34:53.811715+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-27T16:34:54.356 INFO:teuthology.orchestra.run.smithi094.stdout: 2021-01-27T16:34:54.357 INFO:teuthology.orchestra.run.smithi094.stdout:{"epoch":3,"fsid":"294bdd66-60bd-11eb-8f9a-001a4aab830c","modified":"2021-01-27T16:34:47.811529Z","created":"2021-01-27T16:32:24.495275Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3301","nonce":0},{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2021-01-27T16:34:54.359 INFO:teuthology.orchestra.run.smithi094.stderr:dumped monmap epoch 3 2021-01-27T16:34:55.164 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-01-27T16:34:55.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph config generate-minimal-conf 2021-01-27T16:34:55.178 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:54 smithi106 bash[9795]: audit 2021-01-27T16:34:54.358705+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.94:0/1915677591' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:34:55.178 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:54 smithi106 bash[13484]: audit 2021-01-27T16:34:54.358705+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.94:0/1915677591' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:34:55.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:54 smithi094 bash[9811]: audit 2021-01-27T16:34:54.358705+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.94:0/1915677591' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:34:56.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: audit 2021-01-27T16:34:54.955464+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:56.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: cephadm 2021-01-27T16:34:54.956221+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T16:34:56.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: audit 2021-01-27T16:34:54.956723+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: audit 2021-01-27T16:34:54.958551+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: cephadm 2021-01-27T16:34:54.959852+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi106 2021-01-27T16:34:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: audit 2021-01-27T16:34:54.960940+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T16:34:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:55 smithi094 bash[9811]: cluster 2021-01-27T16:34:55.293981+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:56.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: audit 2021-01-27T16:34:54.955464+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:56.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: cephadm 2021-01-27T16:34:54.956221+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T16:34:56.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: audit 2021-01-27T16:34:54.956723+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:56.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: audit 2021-01-27T16:34:54.958551+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:56.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: cephadm 2021-01-27T16:34:54.959852+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi106 2021-01-27T16:34:56.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: audit 2021-01-27T16:34:54.960940+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T16:34:56.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[9795]: cluster 2021-01-27T16:34:55.293981+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:56.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: audit 2021-01-27T16:34:54.955464+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:56.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: cephadm 2021-01-27T16:34:54.956221+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-27T16:34:56.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: audit 2021-01-27T16:34:54.956723+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:56.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: audit 2021-01-27T16:34:54.958551+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:56.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: cephadm 2021-01-27T16:34:54.959852+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi106 2021-01-27T16:34:56.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: audit 2021-01-27T16:34:54.960940+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-27T16:34:56.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:55 smithi106 bash[13484]: cluster 2021-01-27T16:34:55.293981+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:58.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:57 smithi106 bash[9795]: cluster 2021-01-27T16:34:57.294485+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:58.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:57 smithi106 bash[13484]: cluster 2021-01-27T16:34:57.294485+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:58.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:57 smithi094 bash[9811]: cluster 2021-01-27T16:34:57.294485+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:34:59.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: audit 2021-01-27T16:34:57.932571+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:59.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: cephadm 2021-01-27T16:34:57.933820+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T16:34:59.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: audit 2021-01-27T16:34:57.934429+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:59.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: audit 2021-01-27T16:34:57.936157+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:59.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: cephadm 2021-01-27T16:34:57.937332+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi094 2021-01-27T16:34:59.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[9795]: audit 2021-01-27T16:34:57.938236+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T16:34:59.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: audit 2021-01-27T16:34:57.932571+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:59.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: cephadm 2021-01-27T16:34:57.933820+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T16:34:59.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: audit 2021-01-27T16:34:57.934429+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:59.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: audit 2021-01-27T16:34:57.936157+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:59.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: cephadm 2021-01-27T16:34:57.937332+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi094 2021-01-27T16:34:59.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:58 smithi106 bash[13484]: audit 2021-01-27T16:34:57.938236+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T16:34:59.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: audit 2021-01-27T16:34:57.932571+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:34:59.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: cephadm 2021-01-27T16:34:57.933820+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-27T16:34:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: audit 2021-01-27T16:34:57.934429+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:34:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: audit 2021-01-27T16:34:57.936157+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:34:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: cephadm 2021-01-27T16:34:57.937332+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi094 2021-01-27T16:34:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:58 smithi094 bash[9811]: audit 2021-01-27T16:34:57.938236+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-27T16:34:59.335 INFO:teuthology.orchestra.run.smithi106.stdout:# minimal ceph.conf for 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:59.335 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2021-01-27T16:34:59.336 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 294bdd66-60bd-11eb-8f9a-001a4aab830c 2021-01-27T16:34:59.336 INFO:teuthology.orchestra.run.smithi106.stdout: mon_host = [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] 2021-01-27T16:35:00.008 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-01-27T16:35:00.008 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:35:00.009 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T16:35:00.025 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:35:00.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T16:35:00.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:59 smithi094 bash[9811]: cluster 2021-01-27T16:34:59.294821+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:00.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:34:59 smithi094 bash[9811]: audit 2021-01-27T16:34:59.338540+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.106:0/2472812081' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:00.084 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:35:00.084 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.conf 2021-01-27T16:35:00.100 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:35:00.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-27T16:35:00.158 INFO:tasks.cephadm:Adding mgr.y on smithi106 2021-01-27T16:35:00.159 INFO:tasks.cephadm:Adding mgr.x on smithi094 2021-01-27T16:35:00.159 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply mgr '3;smithi106=y;smithi094=x' 2021-01-27T16:35:00.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:59 smithi106 bash[9795]: cluster 2021-01-27T16:34:59.294821+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:00.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:34:59 smithi106 bash[9795]: audit 2021-01-27T16:34:59.338540+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.106:0/2472812081' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:00.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:59 smithi106 bash[13484]: cluster 2021-01-27T16:34:59.294821+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:00.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:34:59 smithi106 bash[13484]: audit 2021-01-27T16:34:59.338540+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.106:0/2472812081' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:01.602 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:00.330946+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.603 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:00.333522+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.603 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:00.334254+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.603 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.112699+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.155566+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.162142+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.163499+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:35:01.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.164882+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:01.604 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:01 smithi094 bash[9811]: audit 2021-01-27T16:35:01.166904+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:00.330946+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:00.333522+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:00.334254+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.112699+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.155566+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.162142+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.163499+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:35:01.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.164882+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:01.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[9795]: audit 2021-01-27T16:35:01.166904+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:00.330946+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:00.333522+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:00.334254+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.112699+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.155566+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.162142+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.163499+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-27T16:35:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.164882+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:01.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:01 smithi106 bash[13484]: audit 2021-01-27T16:35:01.166904+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-27T16:35:02.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[9795]: cephadm 2021-01-27T16:35:01.162977+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T16:35:02.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[9795]: cephadm 2021-01-27T16:35:01.165915+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi106 2021-01-27T16:35:02.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[9795]: cluster 2021-01-27T16:35:01.295220+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:02.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[13484]: cephadm 2021-01-27T16:35:01.162977+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T16:35:02.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[13484]: cephadm 2021-01-27T16:35:01.165915+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi106 2021-01-27T16:35:02.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:02 smithi106 bash[13484]: cluster 2021-01-27T16:35:01.295220+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:02.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:02 smithi094 bash[9811]: cephadm 2021-01-27T16:35:01.162977+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-27T16:35:02.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:02 smithi094 bash[9811]: cephadm 2021-01-27T16:35:01.165915+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring daemon mon.a on smithi106 2021-01-27T16:35:02.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:02 smithi094 bash[9811]: cluster 2021-01-27T16:35:01.295220+0000 mgr.y (mgr.14138) 67 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:03.709 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled mgr update... 2021-01-27T16:35:04.543 DEBUG:teuthology.orchestra.run.smithi094:mgr.x> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@mgr.x.service 2021-01-27T16:35:04.545 INFO:tasks.cephadm:Deploying OSDs... 2021-01-27T16:35:04.545 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:35:04.546 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T16:35:04.553 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T16:35:04.554 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T16:35:04.561 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T16:35:04.561 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.561 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-01-27T16:35:04.561 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.562 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-01-27 16:29:12.161020705 +0000 2021-01-27T16:35:04.562 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-01-27 16:29:12.005020700 +0000 2021-01-27T16:35:04.562 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-01-27 16:29:12.005020700 +0000 2021-01-27T16:35:04.562 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-01-27T16:35:04.570 INFO:journalctl@ceph.mgr.x.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:35:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-01-27T16:35:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-01-27T16:35:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000394771 s, 1.3 MB/s 2021-01-27T16:35:04.576 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T16:35:04.626 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T16:35:04.626 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.626 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-01-27T16:35:04.627 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.627 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-01-27 16:29:12.381020712 +0000 2021-01-27T16:35:04.627 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-01-27 16:29:12.377020712 +0000 2021-01-27T16:35:04.627 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-01-27 16:29:12.377020712 +0000 2021-01-27T16:35:04.628 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-01-27T16:35:04.634 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: cluster 2021-01-27T16:35:03.295669+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:04.634 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:03.342612+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.635 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:03.345000+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.635 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:03.710912+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.635 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.125309+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.635 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.133576+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.636 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.135276+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T16:35:04.636 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.142388+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T16:35:04.636 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.143922+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T16:35:04.636 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.146013+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:04.636 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[13484]: audit 2021-01-27T16:35:04.147990+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.637 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: cluster 2021-01-27T16:35:03.295669+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:04.637 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:03.342612+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.637 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:03.345000+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.637 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:03.710912+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.638 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.125309+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.638 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.133576+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.638 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.135276+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T16:35:04.638 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.142388+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T16:35:04.639 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.143922+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T16:35:04.639 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.146013+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:04.639 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:04 smithi106 bash[9795]: audit 2021-01-27T16:35:04.147990+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.640 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-01-27T16:35:04.640 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-01-27T16:35:04.640 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000390418 s, 1.3 MB/s 2021-01-27T16:35:04.641 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T16:35:04.649 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T16:35:04.649 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.649 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 361 Links: 1 2021-01-27T16:35:04.649 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.650 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-01-27 16:29:12.949020730 +0000 2021-01-27T16:35:04.650 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-01-27 16:29:12.757020724 +0000 2021-01-27T16:35:04.650 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-01-27 16:29:12.757020724 +0000 2021-01-27T16:35:04.650 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-01-27T16:35:04.658 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-01-27T16:35:04.658 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-01-27T16:35:04.658 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000392177 s, 1.3 MB/s 2021-01-27T16:35:04.663 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T16:35:04.669 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T16:35:04.669 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.669 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-01-27T16:35:04.669 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.670 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-01-27 16:29:13.313020742 +0000 2021-01-27T16:35:04.670 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-01-27 16:29:13.165020737 +0000 2021-01-27T16:35:04.670 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-01-27 16:29:13.165020737 +0000 2021-01-27T16:35:04.670 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-01-27T16:35:04.678 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-01-27T16:35:04.678 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-01-27T16:35:04.678 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000316813 s, 1.6 MB/s 2021-01-27T16:35:04.682 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:35:04.682 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2021-01-27T16:35:04.689 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-27T16:35:04.690 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-27T16:35:04.737 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-27T16:35:04.738 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.738 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-01-27T16:35:04.738 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.739 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2021-01-27 16:29:11.714699661 +0000 2021-01-27T16:35:04.739 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2021-01-27 16:29:11.570699665 +0000 2021-01-27T16:35:04.739 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2021-01-27 16:29:11.570699665 +0000 2021-01-27T16:35:04.739 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2021-01-27T16:35:04.746 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: cluster 2021-01-27T16:35:03.295669+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:04.746 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:03.342612+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.746 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:03.345000+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.747 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:03.710912+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.747 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.125309+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.747 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.133576+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:04.747 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.135276+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-27T16:35:04.747 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.142388+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-27T16:35:04.748 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.143922+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-27T16:35:04.748 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.146013+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:04.748 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:04 smithi094 bash[9811]: audit 2021-01-27T16:35:04.147990+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-27T16:35:04.749 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2021-01-27T16:35:04.749 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2021-01-27T16:35:04.749 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000301238 s, 1.7 MB/s 2021-01-27T16:35:04.753 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-27T16:35:04.759 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-27T16:35:04.759 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.759 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-01-27T16:35:04.760 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.760 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2021-01-27 16:29:12.102699650 +0000 2021-01-27T16:35:04.760 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2021-01-27 16:29:11.942699654 +0000 2021-01-27T16:35:04.760 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2021-01-27 16:29:11.942699654 +0000 2021-01-27T16:35:04.760 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2021-01-27T16:35:04.769 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2021-01-27T16:35:04.770 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2021-01-27T16:35:04.770 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000291101 s, 1.8 MB/s 2021-01-27T16:35:04.774 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-27T16:35:04.782 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-27T16:35:04.782 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.782 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-01-27T16:35:04.782 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.783 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2021-01-27 16:29:12.482699639 +0000 2021-01-27T16:35:04.783 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2021-01-27 16:29:12.334699643 +0000 2021-01-27T16:35:04.783 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2021-01-27 16:29:12.334699643 +0000 2021-01-27T16:35:04.783 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2021-01-27T16:35:04.791 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2021-01-27T16:35:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2021-01-27T16:35:04.792 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000205191 s, 2.5 MB/s 2021-01-27T16:35:04.797 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-27T16:35:04.845 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-27T16:35:04.845 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-27T16:35:04.846 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-01-27T16:35:04.846 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-27T16:35:04.846 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2021-01-27 16:29:12.854699629 +0000 2021-01-27T16:35:04.846 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2021-01-27 16:29:12.702699633 +0000 2021-01-27T16:35:04.847 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2021-01-27 16:29:12.702699633 +0000 2021-01-27T16:35:04.847 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2021-01-27T16:35:04.856 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2021-01-27T16:35:04.856 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2021-01-27T16:35:04.857 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000291391 s, 1.8 MB/s 2021-01-27T16:35:04.861 INFO:tasks.cephadm:Deploying osd.0 on smithi106 with /dev/vg_nvme/lv_4... 2021-01-27T16:35:04.861 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T16:35:05.352 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[13484]: audit 2021-01-27T16:35:03.704416+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi106=y;smithi094=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:05.353 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[13484]: cephadm 2021-01-27T16:35:03.705969+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi106=y;smithi094=x;count:3 2021-01-27T16:35:05.353 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[13484]: cephadm 2021-01-27T16:35:04.134534+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='x')] 2021-01-27T16:35:05.353 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[13484]: cephadm 2021-01-27T16:35:04.147129+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi094 2021-01-27T16:35:05.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[9795]: audit 2021-01-27T16:35:03.704416+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi106=y;smithi094=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:05.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[9795]: cephadm 2021-01-27T16:35:03.705969+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi106=y;smithi094=x;count:3 2021-01-27T16:35:05.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[9795]: cephadm 2021-01-27T16:35:04.134534+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='x')] 2021-01-27T16:35:05.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:05 smithi106 bash[9795]: cephadm 2021-01-27T16:35:04.147129+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi094 2021-01-27T16:35:05.701 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:05 smithi094 bash[9811]: audit 2021-01-27T16:35:03.704416+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi106=y;smithi094=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:05.701 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:05 smithi094 bash[9811]: cephadm 2021-01-27T16:35:03.705969+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi106=y;smithi094=x;count:3 2021-01-27T16:35:05.702 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:05 smithi094 bash[9811]: cephadm 2021-01-27T16:35:04.134534+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='x')] 2021-01-27T16:35:05.702 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:05 smithi094 bash[9811]: cephadm 2021-01-27T16:35:04.147129+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi094 2021-01-27T16:35:06.690 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:06 smithi094 bash[9811]: cluster 2021-01-27T16:35:05.296157+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:06 smithi106 bash[13484]: cluster 2021-01-27T16:35:05.296157+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:06.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:06 smithi106 bash[9795]: cluster 2021-01-27T16:35:05.296157+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:07.285 INFO:journalctl@ceph.mgr.x.smithi094.stdout:Jan 27 16:35:07 smithi094 systemd[1]: Started Ceph mgr.x for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:35:08.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.078730+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.081420+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.081965+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: cluster 2021-01-27T16:35:07.296543+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:08.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.889554+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.899090+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.907183+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[13484]: audit 2021-01-27T16:35:07.910083+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.078730+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.081420+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.081965+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: cluster 2021-01-27T16:35:07.296543+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:08.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.889554+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.899090+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.907183+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:08 smithi106 bash[9795]: audit 2021-01-27T16:35:07.910083+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.535 INFO:journalctl@ceph.mgr.x.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[10523]: debug 2021-01-27T16:35:08.275+0000 7f24d3640700 1 -- 172.21.15.94:0/1589523256 <== mon.1 v2:172.21.15.106:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561fff2504e0 con 0x561fff33c800 2021-01-27T16:35:08.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.078730+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.081420+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.081965+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: cluster 2021-01-27T16:35:07.296543+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:08.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.889554+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.899090+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.907183+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:08 smithi094 bash[9811]: audit 2021-01-27T16:35:07.910083+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:08.593 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T16:35:08.593 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T16:35:08.593 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2021-01-27T16:35:08.593 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2021-01-27T16:35:08.594 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0203173 s, 516 MB/s 2021-01-27T16:35:08.594 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2021-01-27T16:35:09.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi106:vg_nvme/lv_4 2021-01-27T16:35:09.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[13484]: cephadm 2021-01-27T16:35:07.908221+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:09.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[13484]: audit 2021-01-27T16:35:08.684253+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:09.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[13484]: audit 2021-01-27T16:35:08.689951+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:09.343 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[9795]: cephadm 2021-01-27T16:35:07.908221+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:09.343 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[9795]: audit 2021-01-27T16:35:08.684253+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:09.343 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:09 smithi106 bash[9795]: audit 2021-01-27T16:35:08.689951+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:09.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:09 smithi094 bash[9811]: cephadm 2021-01-27T16:35:07.908221+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:09.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:09 smithi094 bash[9811]: audit 2021-01-27T16:35:08.684253+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:09.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:09 smithi094 bash[9811]: audit 2021-01-27T16:35:08.689951+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:10.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:10 smithi106 bash[13484]: cephadm 2021-01-27T16:35:08.690661+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:10.449 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:10 smithi106 bash[13484]: cluster 2021-01-27T16:35:09.297111+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:10.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:10 smithi106 bash[9795]: cephadm 2021-01-27T16:35:08.690661+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:10.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:10 smithi106 bash[9795]: cluster 2021-01-27T16:35:09.297111+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:10.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:10 smithi094 bash[9811]: cephadm 2021-01-27T16:35:08.690661+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:10.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:10 smithi094 bash[9811]: cluster 2021-01-27T16:35:09.297111+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:12.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:12 smithi106 bash[13484]: cluster 2021-01-27T16:35:11.297613+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:12.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:12 smithi106 bash[9795]: cluster 2021-01-27T16:35:11.297613+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:12.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:12 smithi094 bash[9811]: cluster 2021-01-27T16:35:11.297613+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:13.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[9795]: audit 2021-01-27T16:35:12.516082+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:13.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[9795]: audit 2021-01-27T16:35:12.520294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:13.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[9795]: audit 2021-01-27T16:35:12.521928+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:13.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[9795]: audit 2021-01-27T16:35:12.524009+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:13.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[13484]: audit 2021-01-27T16:35:12.516082+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:13.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[13484]: audit 2021-01-27T16:35:12.520294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:13.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[13484]: audit 2021-01-27T16:35:12.521928+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:13.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:13 smithi106 bash[13484]: audit 2021-01-27T16:35:12.524009+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:13.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:13 smithi094 bash[9811]: audit 2021-01-27T16:35:12.516082+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:13.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:13 smithi094 bash[9811]: audit 2021-01-27T16:35:12.520294+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:13.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:13 smithi094 bash[9811]: audit 2021-01-27T16:35:12.521928+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:13.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:13 smithi094 bash[9811]: audit 2021-01-27T16:35:12.524009+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:14.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: audit 2021-01-27T16:35:12.514042+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:14.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: cephadm 2021-01-27T16:35:12.519715+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: cluster 2021-01-27T16:35:13.298087+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: cluster 2021-01-27T16:35:13.974758+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2021-01-27T16:35:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: audit 2021-01-27T16:35:13.974869+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T16:35:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[9795]: audit 2021-01-27T16:35:13.979192+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T16:35:14.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: audit 2021-01-27T16:35:12.514042+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:14.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: cephadm 2021-01-27T16:35:12.519715+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:14.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: cluster 2021-01-27T16:35:13.298087+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:14.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: cluster 2021-01-27T16:35:13.974758+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2021-01-27T16:35:14.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: audit 2021-01-27T16:35:13.974869+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T16:35:14.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:14 smithi106 bash[13484]: audit 2021-01-27T16:35:13.979192+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T16:35:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: audit 2021-01-27T16:35:12.514042+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: cephadm 2021-01-27T16:35:12.519715+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: cluster 2021-01-27T16:35:13.298087+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: cluster 2021-01-27T16:35:13.974758+0000 mon.a (mon.0) 227 : cluster [DBG] Standby manager daemon x started 2021-01-27T16:35:14.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: audit 2021-01-27T16:35:13.974869+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-27T16:35:14.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:14 smithi094 bash[9811]: audit 2021-01-27T16:35:13.979192+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.94:0/3119749042' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-27T16:35:15.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:15 smithi106 bash[9795]: cluster 2021-01-27T16:35:14.378901+0000 mon.a (mon.0) 228 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-27T16:35:15.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:15 smithi106 bash[9795]: audit 2021-01-27T16:35:14.379594+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T16:35:15.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:15 smithi106 bash[13484]: cluster 2021-01-27T16:35:14.378901+0000 mon.a (mon.0) 228 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-27T16:35:15.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:15 smithi106 bash[13484]: audit 2021-01-27T16:35:14.379594+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T16:35:15.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:15 smithi094 bash[9811]: cluster 2021-01-27T16:35:14.378901+0000 mon.a (mon.0) 228 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-27T16:35:15.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:15 smithi094 bash[9811]: audit 2021-01-27T16:35:14.379594+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-27T16:35:16.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:16 smithi106 bash[9795]: cluster 2021-01-27T16:35:15.298595+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:16.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:16 smithi106 bash[13484]: cluster 2021-01-27T16:35:15.298595+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:16.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:16 smithi094 bash[9811]: cluster 2021-01-27T16:35:15.298595+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:17.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: audit 2021-01-27T16:35:16.637557+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.106:0/3513914485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: audit 2021-01-27T16:35:16.638433+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: audit 2021-01-27T16:35:16.646098+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]': finished 2021-01-27T16:35:17.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: cluster 2021-01-27T16:35:16.646320+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T16:35:17.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: audit 2021-01-27T16:35:16.646602+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:17.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[9795]: audit 2021-01-27T16:35:17.296000+0000 mon.a (mon.0) 234 : audit [DBG] from='client.? 172.21.15.106:0/2029267145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:17.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: audit 2021-01-27T16:35:16.637557+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.106:0/3513914485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: audit 2021-01-27T16:35:16.638433+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: audit 2021-01-27T16:35:16.646098+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]': finished 2021-01-27T16:35:17.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: cluster 2021-01-27T16:35:16.646320+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T16:35:17.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: audit 2021-01-27T16:35:16.646602+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:17.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:17 smithi106 bash[13484]: audit 2021-01-27T16:35:17.296000+0000 mon.a (mon.0) 234 : audit [DBG] from='client.? 172.21.15.106:0/2029267145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:17.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: audit 2021-01-27T16:35:16.637557+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.106:0/3513914485' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: audit 2021-01-27T16:35:16.638433+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]: dispatch 2021-01-27T16:35:17.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: audit 2021-01-27T16:35:16.646098+0000 mon.a (mon.0) 231 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602f7089-9ced-4651-aec4-152bc61f3a3f"}]': finished 2021-01-27T16:35:17.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: cluster 2021-01-27T16:35:16.646320+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-27T16:35:17.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: audit 2021-01-27T16:35:16.646602+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:17.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:17 smithi094 bash[9811]: audit 2021-01-27T16:35:17.296000+0000 mon.a (mon.0) 234 : audit [DBG] from='client.? 172.21.15.106:0/2029267145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:18.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:18 smithi106 bash[9795]: cluster 2021-01-27T16:35:17.299029+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:18.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:18 smithi106 bash[13484]: cluster 2021-01-27T16:35:17.299029+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:18.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:18 smithi094 bash[9811]: cluster 2021-01-27T16:35:17.299029+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:20.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:20 smithi106 bash[9795]: cluster 2021-01-27T16:35:19.299554+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:20.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:20 smithi106 bash[13484]: cluster 2021-01-27T16:35:19.299554+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:20.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:20 smithi094 bash[9811]: cluster 2021-01-27T16:35:19.299554+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:21.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:21 smithi106 bash[9795]: audit 2021-01-27T16:35:20.504236+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:21.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:21 smithi106 bash[13484]: audit 2021-01-27T16:35:20.504236+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:21.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:21 smithi094 bash[9811]: audit 2021-01-27T16:35:20.504236+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:22.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:22 smithi106 bash[9795]: cluster 2021-01-27T16:35:21.300071+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:22.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:22 smithi106 bash[9795]: cluster 2021-01-27T16:35:21.400980+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:22.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:22 smithi106 bash[13484]: cluster 2021-01-27T16:35:21.300071+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:22.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:22 smithi106 bash[13484]: cluster 2021-01-27T16:35:21.400980+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:22.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:22 smithi094 bash[9811]: cluster 2021-01-27T16:35:21.300071+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:22.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:22 smithi094 bash[9811]: cluster 2021-01-27T16:35:21.400980+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:23.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:23 smithi106 bash[9795]: cluster 2021-01-27T16:35:23.300603+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:23.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:23 smithi106 bash[13484]: cluster 2021-01-27T16:35:23.300603+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:23.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:23 smithi094 bash[9811]: cluster 2021-01-27T16:35:23.300603+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:25.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:25 smithi094 bash[9811]: audit 2021-01-27T16:35:24.952315+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T16:35:25.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:25 smithi094 bash[9811]: audit 2021-01-27T16:35:24.953885+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:25.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:25 smithi094 bash[9811]: audit 2021-01-27T16:35:24.955650+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T16:35:25.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[9795]: audit 2021-01-27T16:35:24.952315+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T16:35:25.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[9795]: audit 2021-01-27T16:35:24.953885+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:25.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[9795]: audit 2021-01-27T16:35:24.955650+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T16:35:25.354 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[13484]: audit 2021-01-27T16:35:24.952315+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-27T16:35:25.354 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[13484]: audit 2021-01-27T16:35:24.953885+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:25.354 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:25 smithi106 bash[13484]: audit 2021-01-27T16:35:24.955650+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-27T16:35:26.273 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[13484]: cephadm 2021-01-27T16:35:24.955096+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi106 2021-01-27T16:35:26.273 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[13484]: cluster 2021-01-27T16:35:25.301127+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:26.273 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[13484]: audit 2021-01-27T16:35:25.470450+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:35:26.274 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[13484]: audit 2021-01-27T16:35:25.473134+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:35:26.274 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[9795]: cephadm 2021-01-27T16:35:24.955096+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi106 2021-01-27T16:35:26.274 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[9795]: cluster 2021-01-27T16:35:25.301127+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:26.275 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[9795]: audit 2021-01-27T16:35:25.470450+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:35:26.275 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:26 smithi106 bash[9795]: audit 2021-01-27T16:35:25.473134+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:35:26.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:26 smithi094 bash[9811]: cephadm 2021-01-27T16:35:24.955096+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi106 2021-01-27T16:35:26.308 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:26 smithi094 bash[9811]: cluster 2021-01-27T16:35:25.301127+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:26.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:26 smithi094 bash[9811]: audit 2021-01-27T16:35:25.470450+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:35:26.309 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:26 smithi094 bash[9811]: audit 2021-01-27T16:35:25.473134+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:35:27.599 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 0 on host 'smithi106' 2021-01-27T16:35:27.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[9795]: cluster 2021-01-27T16:35:27.301513+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:27.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[9795]: audit 2021-01-27T16:35:27.593332+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:27.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[9795]: audit 2021-01-27T16:35:27.597269+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:27.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[13484]: cluster 2021-01-27T16:35:27.301513+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:27.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[13484]: audit 2021-01-27T16:35:27.593332+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:27.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:27 smithi106 bash[13484]: audit 2021-01-27T16:35:27.597269+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:28.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:27 smithi094 bash[9811]: cluster 2021-01-27T16:35:27.301513+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:28.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:27 smithi094 bash[9811]: audit 2021-01-27T16:35:27.593332+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:28.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:27 smithi094 bash[9811]: audit 2021-01-27T16:35:27.597269+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:28.900 DEBUG:teuthology.orchestra.run.smithi106:osd.0> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.0.service 2021-01-27T16:35:28.944 INFO:tasks.cephadm:Deploying osd.1 on smithi106 with /dev/vg_nvme/lv_3... 2021-01-27T16:35:28.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T16:35:28.998 INFO:journalctl@ceph.osd.0.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:35:29.138 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[13484]: cephadm 2021-01-27T16:35:27.593157+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:35:29.138 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[13484]: audit 2021-01-27T16:35:28.469021+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:29.138 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[13484]: audit 2021-01-27T16:35:28.470631+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:29.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[9795]: cephadm 2021-01-27T16:35:27.593157+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:35:29.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[9795]: audit 2021-01-27T16:35:28.469021+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:29.139 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:28 smithi106 bash[9795]: audit 2021-01-27T16:35:28.470631+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:29.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:28 smithi094 bash[9811]: cephadm 2021-01-27T16:35:27.593157+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:35:29.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:28 smithi094 bash[9811]: audit 2021-01-27T16:35:28.469021+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:29.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:28 smithi094 bash[9811]: audit 2021-01-27T16:35:28.470631+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:30.114 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:29 smithi106 bash[9795]: cluster 2021-01-27T16:35:29.302074+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:30.114 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:29 smithi106 bash[13484]: cluster 2021-01-27T16:35:29.302074+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:30.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:29 smithi094 bash[9811]: cluster 2021-01-27T16:35:29.302074+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:30.453 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T16:35:30.454 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-01-27T16:35:30.454 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-01-27T16:35:30.454 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-01-27T16:35:30.455 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T16:35:30.455 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-27T16:35:30.455 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:30 smithi106 bash[16241]: --> ceph-volume lvm activate successful for osd ID: 0 2021-01-27T16:35:32.651 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:32 smithi106 bash[13484]: cluster 2021-01-27T16:35:31.302661+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:32.651 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:32 smithi106 bash[9795]: cluster 2021-01-27T16:35:31.302661+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:32.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:32 smithi094 bash[9811]: cluster 2021-01-27T16:35:31.302661+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:34.663 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[9795]: cluster 2021-01-27T16:35:33.303211+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:34.664 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[13484]: cluster 2021-01-27T16:35:33.303211+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:34.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:34 smithi094 bash[9811]: cluster 2021-01-27T16:35:33.303211+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:34.949 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81311f1700 10 -- 172.21.15.106:0/800122613 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-27T16:35:34.950 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81311f1700 20 -- 172.21.15.106:0/800122613 done calling dispatch on 0x5579bc90ac60 2021-01-27T16:35:34.950 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 msgr2=0x5579bc8ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:35:34.950 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 msgr2=0x5579bc8ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:35:34.951 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_read_frame_preamble_main r=0 2021-01-27T16:35:34.951 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_MESSAGE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).throttle_message 2021-01-27T16:35:34.951 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_BYTES pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).throttle_bytes 2021-01-27T16:35:34.951 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).throttle_dispatch_queue 2021-01-27T16:35:34.952 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).read_frame_segment seg_idx=0 2021-01-27T16:35:34.952 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).read_frame_segment seg_idx=1 2021-01-27T16:35:34.952 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 msgr2=0x5579bc8ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:35:34.952 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_read_frame_segment r=0 2021-01-27T16:35:34.952 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 msgr2=0x5579bc8ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:35:34.953 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_read_frame_epilogue_main r=0 2021-01-27T16:35:34.953 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 10 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_read_frame_dispatch tag=17 2021-01-27T16:35:34.953 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_message 2021-01-27T16:35:34.953 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 5 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T16:35:34.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 5 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).handle_message received message m=0x5579bc9144e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:35:34.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 queue 0x5579bc9144e0 prio 196 2021-01-27T16:35:34.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 --2- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 0x5579bc8ff400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x5579bc90fec0 tx=0x5579bc9440c0).read_frame 2021-01-27T16:35:34.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81321f3700 20 -- 172.21.15.106:0/800122613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5579bc992c00 msgr2=0x5579bc8ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:35:34.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81311f1700 1 -- 172.21.15.106:0/800122613 <== mon.0 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5579bc9144e0 con 0x5579bc992c00 2021-01-27T16:35:34.955 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81311f1700 10 -- 172.21.15.106:0/800122613 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:35:34.955 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:34 smithi106 bash[16567]: debug 2021-01-27T16:35:34.765+0000 7f81311f1700 20 -- 172.21.15.106:0/800122613 done calling dispatch on 0x5579bc9144e0 2021-01-27T16:35:35.699 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:35 smithi106 bash[16567]: debug 2021-01-27T16:35:35.317+0000 7f8138c7c200 -1 Falling back to public interface 2021-01-27T16:35:36.005 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T16:35:36.006 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T16:35:36.006 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2021-01-27T16:35:36.006 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2021-01-27T16:35:36.006 INFO:teuthology.orchestra.run.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0175046 s, 599 MB/s 2021-01-27T16:35:36.007 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2021-01-27T16:35:36.575 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:36 smithi106 bash[13484]: cluster 2021-01-27T16:35:35.303647+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:36.576 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:36 smithi106 bash[9795]: cluster 2021-01-27T16:35:35.303647+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:36.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:36 smithi094 bash[9811]: cluster 2021-01-27T16:35:35.303647+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:36.986 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi106:vg_nvme/lv_3 2021-01-27T16:35:38.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:37 smithi106 bash[9795]: cluster 2021-01-27T16:35:37.304184+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:38.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:37 smithi106 bash[9795]: audit 2021-01-27T16:35:37.695081+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:38.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:37 smithi106 bash[13484]: cluster 2021-01-27T16:35:37.304184+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:38.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:37 smithi106 bash[13484]: audit 2021-01-27T16:35:37.695081+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:38.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:37 smithi094 bash[9811]: cluster 2021-01-27T16:35:37.304184+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:38.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:37 smithi094 bash[9811]: audit 2021-01-27T16:35:37.695081+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:38.537 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:38 smithi106 bash[16567]: debug 2021-01-27T16:35:38.341+0000 7f8138c7c200 -1 osd.0 0 log_to_monitors {default=true} 2021-01-27T16:35:39.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: audit 2021-01-27T16:35:38.045405+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: audit 2021-01-27T16:35:38.051074+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: cephadm 2021-01-27T16:35:38.052354+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: audit 2021-01-27T16:35:38.057869+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: cephadm 2021-01-27T16:35:38.058750+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[9795]: audit 2021-01-27T16:35:38.350739+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T16:35:39.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: audit 2021-01-27T16:35:38.045405+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: audit 2021-01-27T16:35:38.051074+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: cephadm 2021-01-27T16:35:38.052354+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: audit 2021-01-27T16:35:38.057869+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: cephadm 2021-01-27T16:35:38.058750+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:39 smithi106 bash[13484]: audit 2021-01-27T16:35:38.350739+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T16:35:39.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: audit 2021-01-27T16:35:38.045405+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: audit 2021-01-27T16:35:38.051074+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: cephadm 2021-01-27T16:35:38.052354+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: audit 2021-01-27T16:35:38.057869+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: cephadm 2021-01-27T16:35:38.058750+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:35:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:39 smithi094 bash[9811]: audit 2021-01-27T16:35:38.350739+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-27T16:35:40.449 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[16567]: debug 2021-01-27T16:35:40.069+0000 7f812f1ed700 -1 osd.0 0 waiting for initial osdmap 2021-01-27T16:35:40.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[9795]: audit 2021-01-27T16:35:39.060662+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T16:35:40.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[9795]: cluster 2021-01-27T16:35:39.060746+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T16:35:40.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[9795]: audit 2021-01-27T16:35:39.060944+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:40.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[9795]: audit 2021-01-27T16:35:39.061794+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:35:40.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[9795]: cluster 2021-01-27T16:35:39.304726+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:40.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[13484]: audit 2021-01-27T16:35:39.060662+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T16:35:40.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[13484]: cluster 2021-01-27T16:35:39.060746+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T16:35:40.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[13484]: audit 2021-01-27T16:35:39.060944+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:40.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[13484]: audit 2021-01-27T16:35:39.061794+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:35:40.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:40 smithi106 bash[13484]: cluster 2021-01-27T16:35:39.304726+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:40.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:40 smithi094 bash[9811]: audit 2021-01-27T16:35:39.060662+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-27T16:35:40.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:40 smithi094 bash[9811]: cluster 2021-01-27T16:35:39.060746+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-27T16:35:40.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:40 smithi094 bash[9811]: audit 2021-01-27T16:35:39.060944+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:40.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:40 smithi094 bash[9811]: audit 2021-01-27T16:35:39.061794+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:35:40.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:40 smithi094 bash[9811]: cluster 2021-01-27T16:35:39.304726+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:41.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.065995+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:35:41.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: cluster 2021-01-27T16:35:40.066152+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T16:35:41.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.067062+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.077211+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.503744+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:41.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.506433+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:41.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.507755+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:41.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[9795]: audit 2021-01-27T16:35:40.509431+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:41.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.065995+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:35:41.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: cluster 2021-01-27T16:35:40.066152+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T16:35:41.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.067062+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.077211+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.503744+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:41.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.506433+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:41.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.507755+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:41.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:41 smithi106 bash[13484]: audit 2021-01-27T16:35:40.509431+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:41.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.065995+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:35:41.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: cluster 2021-01-27T16:35:40.066152+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-27T16:35:41.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.067062+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.077211+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:41.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.503744+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:35:41.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.506433+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:35:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.507755+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:41 smithi094 bash[9811]: audit 2021-01-27T16:35:40.509431+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:42.287 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cluster 2021-01-27T16:35:39.387713+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:35:42.287 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cluster 2021-01-27T16:35:39.387950+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:35:42.287 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: audit 2021-01-27T16:35:40.501876+0000 mgr.y (mgr.14138) 99 : audit [DBG] from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:42.288 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cephadm 2021-01-27T16:35:40.506022+0000 mgr.y (mgr.14138) 100 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:42.288 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cluster 2021-01-27T16:35:41.076683+0000 mon.a (mon.0) 263 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:35:42.288 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cluster 2021-01-27T16:35:41.076773+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T16:35:42.288 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: audit 2021-01-27T16:35:41.077620+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:42.288 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[9795]: cluster 2021-01-27T16:35:41.305268+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v68: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:42.289 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cluster 2021-01-27T16:35:39.387713+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:35:42.289 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cluster 2021-01-27T16:35:39.387950+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:35:42.289 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: audit 2021-01-27T16:35:40.501876+0000 mgr.y (mgr.14138) 99 : audit [DBG] from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:42.289 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cephadm 2021-01-27T16:35:40.506022+0000 mgr.y (mgr.14138) 100 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:42.290 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cluster 2021-01-27T16:35:41.076683+0000 mon.a (mon.0) 263 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:35:42.290 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cluster 2021-01-27T16:35:41.076773+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T16:35:42.290 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: audit 2021-01-27T16:35:41.077620+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:42.290 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:42 smithi106 bash[13484]: cluster 2021-01-27T16:35:41.305268+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v68: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:42.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cluster 2021-01-27T16:35:39.387713+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:35:42.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cluster 2021-01-27T16:35:39.387950+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:35:42.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: audit 2021-01-27T16:35:40.501876+0000 mgr.y (mgr.14138) 99 : audit [DBG] from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:35:42.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cephadm 2021-01-27T16:35:40.506022+0000 mgr.y (mgr.14138) 100 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:35:42.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cluster 2021-01-27T16:35:41.076683+0000 mon.a (mon.0) 263 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:35:42.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cluster 2021-01-27T16:35:41.076773+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-27T16:35:42.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: audit 2021-01-27T16:35:41.077620+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:35:42.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:42 smithi094 bash[9811]: cluster 2021-01-27T16:35:41.305268+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v68: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-27T16:35:43.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:43 smithi106 bash[9795]: cluster 2021-01-27T16:35:42.097490+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T16:35:43.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:43 smithi106 bash[13484]: cluster 2021-01-27T16:35:42.097490+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T16:35:43.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:43 smithi094 bash[9811]: cluster 2021-01-27T16:35:42.097490+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-27T16:35:44.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:44 smithi106 bash[9795]: cluster 2021-01-27T16:35:43.095669+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T16:35:44.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:44 smithi106 bash[9795]: cluster 2021-01-27T16:35:43.305857+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:44.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:44 smithi106 bash[13484]: cluster 2021-01-27T16:35:43.095669+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T16:35:44.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:44 smithi106 bash[13484]: cluster 2021-01-27T16:35:43.305857+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:44.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:44 smithi094 bash[9811]: cluster 2021-01-27T16:35:43.095669+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-27T16:35:44.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:44 smithi094 bash[9811]: cluster 2021-01-27T16:35:43.305857+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v71: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:45.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[9795]: cluster 2021-01-27T16:35:44.101823+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:35:45.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[9795]: audit 2021-01-27T16:35:44.606271+0000 mon.a (mon.0) 269 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]: dispatch 2021-01-27T16:35:45.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[9795]: audit 2021-01-27T16:35:44.611445+0000 mon.a (mon.0) 270 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]': finished 2021-01-27T16:35:45.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[9795]: cluster 2021-01-27T16:35:44.611498+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T16:35:45.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[9795]: audit 2021-01-27T16:35:44.611712+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:35:45.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[13484]: cluster 2021-01-27T16:35:44.101823+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:35:45.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[13484]: audit 2021-01-27T16:35:44.606271+0000 mon.a (mon.0) 269 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]: dispatch 2021-01-27T16:35:45.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[13484]: audit 2021-01-27T16:35:44.611445+0000 mon.a (mon.0) 270 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]': finished 2021-01-27T16:35:45.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[13484]: cluster 2021-01-27T16:35:44.611498+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T16:35:45.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:45 smithi106 bash[13484]: audit 2021-01-27T16:35:44.611712+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:35:45.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:45 smithi094 bash[9811]: cluster 2021-01-27T16:35:44.101823+0000 mon.a (mon.0) 268 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:35:45.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:45 smithi094 bash[9811]: audit 2021-01-27T16:35:44.606271+0000 mon.a (mon.0) 269 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]: dispatch 2021-01-27T16:35:45.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:45 smithi094 bash[9811]: audit 2021-01-27T16:35:44.611445+0000 mon.a (mon.0) 270 : audit [INF] from='client.? 172.21.15.106:0/2062252437' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa"}]': finished 2021-01-27T16:35:45.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:45 smithi094 bash[9811]: cluster 2021-01-27T16:35:44.611498+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-27T16:35:45.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:45 smithi094 bash[9811]: audit 2021-01-27T16:35:44.611712+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:35:46.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:46 smithi106 bash[9795]: audit 2021-01-27T16:35:45.240889+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.106:0/874367292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:46.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:46 smithi106 bash[9795]: cluster 2021-01-27T16:35:45.306397+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:46.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:46 smithi106 bash[13484]: audit 2021-01-27T16:35:45.240889+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.106:0/874367292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:46.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:46 smithi106 bash[13484]: cluster 2021-01-27T16:35:45.306397+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:46.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:46 smithi094 bash[9811]: audit 2021-01-27T16:35:45.240889+0000 mon.c (mon.1) 6 : audit [DBG] from='client.? 172.21.15.106:0/874367292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:35:46.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:46 smithi094 bash[9811]: cluster 2021-01-27T16:35:45.306397+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:48.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:47 smithi106 bash[9795]: cluster 2021-01-27T16:35:47.306987+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:48.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:47 smithi106 bash[13484]: cluster 2021-01-27T16:35:47.306987+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:48.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:47 smithi094 bash[9811]: cluster 2021-01-27T16:35:47.306987+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:49.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:48 smithi106 bash[9795]: audit 2021-01-27T16:35:48.446805+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:49.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:48 smithi106 bash[13484]: audit 2021-01-27T16:35:48.446805+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:49.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:48 smithi094 bash[9811]: audit 2021-01-27T16:35:48.446805+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:50.194 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:49 smithi106 bash[9795]: cluster 2021-01-27T16:35:49.307614+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:50.195 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:49 smithi106 bash[13484]: cluster 2021-01-27T16:35:49.307614+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:50.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:49 smithi094 bash[9811]: cluster 2021-01-27T16:35:49.307614+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:52.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:52 smithi106 bash[9795]: cluster 2021-01-27T16:35:51.308256+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:52.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:52 smithi106 bash[9795]: cluster 2021-01-27T16:35:51.884748+0000 mon.a (mon.0) 274 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:52.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:52 smithi106 bash[13484]: cluster 2021-01-27T16:35:51.308256+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:52.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:52 smithi106 bash[13484]: cluster 2021-01-27T16:35:51.884748+0000 mon.a (mon.0) 274 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:52.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:52 smithi094 bash[9811]: cluster 2021-01-27T16:35:51.308256+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:52.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:52 smithi094 bash[9811]: cluster 2021-01-27T16:35:51.884748+0000 mon.a (mon.0) 274 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-27T16:35:53.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[9795]: audit 2021-01-27T16:35:52.980640+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T16:35:53.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[9795]: audit 2021-01-27T16:35:52.982431+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:53.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[9795]: audit 2021-01-27T16:35:52.984816+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T16:35:53.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[13484]: audit 2021-01-27T16:35:52.980640+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T16:35:53.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[13484]: audit 2021-01-27T16:35:52.982431+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:53.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:53 smithi106 bash[13484]: audit 2021-01-27T16:35:52.984816+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T16:35:53.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:53 smithi094 bash[9811]: audit 2021-01-27T16:35:52.980640+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-27T16:35:53.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:53 smithi094 bash[9811]: audit 2021-01-27T16:35:52.982431+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:35:53.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:53 smithi094 bash[9811]: audit 2021-01-27T16:35:52.984816+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-27T16:35:54.576 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:54 smithi106 bash[9795]: cephadm 2021-01-27T16:35:52.983852+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi106 2021-01-27T16:35:54.577 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:54 smithi106 bash[9795]: cluster 2021-01-27T16:35:53.308900+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:54.577 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:54 smithi106 bash[13484]: cephadm 2021-01-27T16:35:52.983852+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi106 2021-01-27T16:35:54.577 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:54 smithi106 bash[13484]: cluster 2021-01-27T16:35:53.308900+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:54.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:54 smithi094 bash[9811]: cephadm 2021-01-27T16:35:52.983852+0000 mgr.y (mgr.14138) 107 : cephadm [INF] Deploying daemon osd.1 on smithi106 2021-01-27T16:35:54.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:54 smithi094 bash[9811]: cluster 2021-01-27T16:35:53.308900+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:55.599 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 1 on host 'smithi106' 2021-01-27T16:35:56.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[13484]: cluster 2021-01-27T16:35:55.309571+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:56.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[13484]: audit 2021-01-27T16:35:55.597561+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:56.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[13484]: audit 2021-01-27T16:35:55.602358+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:56.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[9795]: cluster 2021-01-27T16:35:55.309571+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:56.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[9795]: audit 2021-01-27T16:35:55.597561+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:56.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:56 smithi106 bash[9795]: audit 2021-01-27T16:35:55.602358+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:56.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:56 smithi094 bash[9811]: cluster 2021-01-27T16:35:55.309571+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:56.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:56 smithi094 bash[9811]: audit 2021-01-27T16:35:55.597561+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:35:56.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:56 smithi094 bash[9811]: audit 2021-01-27T16:35:55.602358+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:57.256 DEBUG:teuthology.orchestra.run.smithi106:osd.1> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.1.service 2021-01-27T16:35:57.264 INFO:tasks.cephadm:Deploying osd.2 on smithi106 with /dev/vg_nvme/lv_2... 2021-01-27T16:35:57.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T16:35:57.293 INFO:journalctl@ceph.osd.1.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:35:57.866 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[13484]: audit 2021-01-27T16:35:56.566677+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:57.867 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[13484]: audit 2021-01-27T16:35:56.568655+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:57.867 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[13484]: cluster 2021-01-27T16:35:57.310232+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:57.867 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[9795]: audit 2021-01-27T16:35:56.566677+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:57.867 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[9795]: audit 2021-01-27T16:35:56.568655+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:57.868 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:35:57 smithi106 bash[9795]: cluster 2021-01-27T16:35:57.310232+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:58.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:57 smithi094 bash[9811]: audit 2021-01-27T16:35:56.566677+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:35:58.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:57 smithi094 bash[9811]: audit 2021-01-27T16:35:56.568655+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:35:58.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:35:57 smithi094 bash[9811]: cluster 2021-01-27T16:35:57.310232+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:35:58.949 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T16:35:58.949 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-01-27T16:35:58.949 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-01-27T16:35:58.950 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-01-27T16:35:58.950 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T16:35:58.950 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-27T16:35:58.950 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:35:58 smithi106 bash[18716]: --> ceph-volume lvm activate successful for osd ID: 1 2021-01-27T16:36:00.713 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:00 smithi106 bash[9795]: cluster 2021-01-27T16:35:59.310868+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:00.713 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:00 smithi106 bash[13484]: cluster 2021-01-27T16:35:59.310868+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:00.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:00 smithi094 bash[9811]: cluster 2021-01-27T16:35:59.310868+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:02.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:02 smithi106 bash[9795]: cluster 2021-01-27T16:36:01.311530+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:02.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:02 smithi106 bash[13484]: cluster 2021-01-27T16:36:01.311530+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:02.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:02 smithi094 bash[9811]: cluster 2021-01-27T16:36:01.311530+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:03.594 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 msgr2=0x55af562d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:36:03.594 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 msgr2=0x55af562d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:36:03.595 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_read_frame_preamble_main r=0 2021-01-27T16:36:03.595 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_MESSAGE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).throttle_message 2021-01-27T16:36:03.595 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_BYTES pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).throttle_bytes 2021-01-27T16:36:03.596 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).throttle_dispatch_queue 2021-01-27T16:36:03.596 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).read_frame_segment seg_idx=0 2021-01-27T16:36:03.596 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).read_frame_segment seg_idx=1 2021-01-27T16:36:03.596 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 msgr2=0x55af562d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:36:03.597 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_read_frame_segment r=0 2021-01-27T16:36:03.597 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 msgr2=0x55af562d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:36:03.597 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_read_frame_epilogue_main r=0 2021-01-27T16:36:03.597 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 10 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_read_frame_dispatch tag=17 2021-01-27T16:36:03.598 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_message 2021-01-27T16:36:03.598 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 5 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T16:36:03.598 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 5 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).handle_message received message m=0x55af562e84e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:36:03.598 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 queue 0x55af562e84e0 prio 196 2021-01-27T16:36:03.599 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 --2- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 0x55af562d3400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x55af562e3e60 tx=0x55af563180c0).read_frame 2021-01-27T16:36:03.599 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f2120e36700 20 -- 172.21.15.106:0/97498828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55af56366c00 msgr2=0x55af562d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:36:03.599 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f211fe34700 1 -- 172.21.15.106:0/97498828 <== mon.0 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af562e84e0 con 0x55af56366c00 2021-01-27T16:36:03.599 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f211fe34700 10 -- 172.21.15.106:0/97498828 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:36:03.600 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:03 smithi106 bash[19045]: debug 2021-01-27T16:36:03.461+0000 7f211fe34700 20 -- 172.21.15.106:0/97498828 done calling dispatch on 0x55af562e84e0 2021-01-27T16:36:04.198 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:04 smithi106 bash[19045]: debug 2021-01-27T16:36:04.013+0000 7f21278bf200 -1 Falling back to public interface 2021-01-27T16:36:04.499 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T16:36:04.500 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T16:36:04.500 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2021-01-27T16:36:04.500 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2021-01-27T16:36:04.500 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0160126 s, 655 MB/s 2021-01-27T16:36:04.501 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2021-01-27T16:36:04.684 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:04 smithi106 bash[9795]: cluster 2021-01-27T16:36:03.312299+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:04.684 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:04 smithi106 bash[13484]: cluster 2021-01-27T16:36:03.312299+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:04 smithi094 bash[9811]: cluster 2021-01-27T16:36:03.312299+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:05.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi106:vg_nvme/lv_2 2021-01-27T16:36:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:06 smithi106 bash[9795]: cluster 2021-01-27T16:36:05.313004+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:06.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:06 smithi106 bash[9795]: audit 2021-01-27T16:36:06.229506+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:06 smithi106 bash[13484]: cluster 2021-01-27T16:36:05.313004+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:06 smithi106 bash[13484]: audit 2021-01-27T16:36:06.229506+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:06 smithi094 bash[9811]: cluster 2021-01-27T16:36:05.313004+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:06.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:06 smithi094 bash[9811]: audit 2021-01-27T16:36:06.229506+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:07.448 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[19045]: debug 2021-01-27T16:36:07.037+0000 7f21278bf200 -1 osd.1 0 log_to_monitors {default=true} 2021-01-27T16:36:07.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: audit 2021-01-27T16:36:06.585027+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: cephadm 2021-01-27T16:36:06.586065+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:36:07.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: audit 2021-01-27T16:36:07.004698+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: cephadm 2021-01-27T16:36:07.005811+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:07.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: audit 2021-01-27T16:36:07.012858+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: cephadm 2021-01-27T16:36:07.014174+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:07.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: audit 2021-01-27T16:36:07.044041+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T16:36:07.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[13484]: cluster 2021-01-27T16:36:07.313651+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: audit 2021-01-27T16:36:06.585027+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: cephadm 2021-01-27T16:36:06.586065+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:36:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: audit 2021-01-27T16:36:07.004698+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: cephadm 2021-01-27T16:36:07.005811+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:07.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: audit 2021-01-27T16:36:07.012858+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:07.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: cephadm 2021-01-27T16:36:07.014174+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:07.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: audit 2021-01-27T16:36:07.044041+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T16:36:07.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:07 smithi106 bash[9795]: cluster 2021-01-27T16:36:07.313651+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:08.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: audit 2021-01-27T16:36:06.585027+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:08.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: cephadm 2021-01-27T16:36:06.586065+0000 mgr.y (mgr.14138) 115 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:36:08.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: audit 2021-01-27T16:36:07.004698+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:08.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: cephadm 2021-01-27T16:36:07.005811+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:08.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: audit 2021-01-27T16:36:07.012858+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:08.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: cephadm 2021-01-27T16:36:07.014174+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:08.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: audit 2021-01-27T16:36:07.044041+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-27T16:36:08.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:07 smithi094 bash[9811]: cluster 2021-01-27T16:36:07.313651+0000 mgr.y (mgr.14138) 118 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:09.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:09 smithi094 bash[9811]: audit 2021-01-27T16:36:08.017940+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T16:36:09.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:09 smithi094 bash[9811]: cluster 2021-01-27T16:36:08.018157+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T16:36:09.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:09 smithi094 bash[9811]: audit 2021-01-27T16:36:08.018933+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:09.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:09 smithi094 bash[9811]: audit 2021-01-27T16:36:08.020182+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:09.448 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[19045]: debug 2021-01-27T16:36:09.025+0000 7f211f633700 -1 osd.1 0 waiting for initial osdmap 2021-01-27T16:36:09.449 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[13484]: audit 2021-01-27T16:36:08.017940+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T16:36:09.449 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[13484]: cluster 2021-01-27T16:36:08.018157+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T16:36:09.449 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[13484]: audit 2021-01-27T16:36:08.018933+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:09.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[13484]: audit 2021-01-27T16:36:08.020182+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:09.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[9795]: audit 2021-01-27T16:36:08.017940+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-27T16:36:09.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[9795]: cluster 2021-01-27T16:36:08.018157+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-27T16:36:09.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[9795]: audit 2021-01-27T16:36:08.018933+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:09.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:09 smithi106 bash[9795]: audit 2021-01-27T16:36:08.020182+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:10.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.019720+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:10.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: cluster 2021-01-27T16:36:09.019955+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T16:36:10.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.020665+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.030327+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.114162+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:10.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.116056+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:10.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: cephadm 2021-01-27T16:36:09.118573+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:10.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.118978+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.120336+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: audit 2021-01-27T16:36:09.122078+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:10 smithi094 bash[9811]: cluster 2021-01-27T16:36:09.314139+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:10.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.019720+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:10.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: cluster 2021-01-27T16:36:09.019955+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T16:36:10.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.020665+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.030327+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.114162+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:10.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.116056+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:10.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: cephadm 2021-01-27T16:36:09.118573+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:10.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.118978+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:10.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.120336+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:10.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: audit 2021-01-27T16:36:09.122078+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:10.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[9795]: cluster 2021-01-27T16:36:09.314139+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:10.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.019720+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:10.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: cluster 2021-01-27T16:36:09.019955+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-27T16:36:10.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.020665+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.030327+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:10.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.114162+0000 mgr.y (mgr.14138) 119 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:10.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.116056+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:10.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: cephadm 2021-01-27T16:36:09.118573+0000 mgr.y (mgr.14138) 120 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:10.453 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.118978+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:10.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.120336+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:10.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: audit 2021-01-27T16:36:09.122078+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:10.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:10 smithi106 bash[13484]: cluster 2021-01-27T16:36:09.314139+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v87: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-27T16:36:11.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:11 smithi094 bash[9811]: cluster 2021-01-27T16:36:08.089254+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:11.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:11 smithi094 bash[9811]: cluster 2021-01-27T16:36:08.089453+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:11.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:11 smithi094 bash[9811]: cluster 2021-01-27T16:36:10.031260+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:36:11.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:11 smithi094 bash[9811]: cluster 2021-01-27T16:36:10.031321+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T16:36:11.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:11 smithi094 bash[9811]: audit 2021-01-27T16:36:10.032143+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:11.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[9795]: cluster 2021-01-27T16:36:08.089254+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:11.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[9795]: cluster 2021-01-27T16:36:08.089453+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:11.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[9795]: cluster 2021-01-27T16:36:10.031260+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:36:11.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[9795]: cluster 2021-01-27T16:36:10.031321+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T16:36:11.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[9795]: audit 2021-01-27T16:36:10.032143+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:11.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[13484]: cluster 2021-01-27T16:36:08.089254+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:11.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[13484]: cluster 2021-01-27T16:36:08.089453+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:11.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[13484]: cluster 2021-01-27T16:36:10.031260+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:36:11.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[13484]: cluster 2021-01-27T16:36:10.031321+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-27T16:36:11.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:11 smithi106 bash[13484]: audit 2021-01-27T16:36:10.032143+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:36:12.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:12 smithi106 bash[13484]: cluster 2021-01-27T16:36:11.050356+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T16:36:12.449 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:12 smithi106 bash[13484]: cluster 2021-01-27T16:36:11.314687+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:12.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:12 smithi106 bash[9795]: cluster 2021-01-27T16:36:11.050356+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T16:36:12.449 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:12 smithi106 bash[9795]: cluster 2021-01-27T16:36:11.314687+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:12.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:12 smithi094 bash[9811]: cluster 2021-01-27T16:36:11.050356+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-27T16:36:12.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:12 smithi094 bash[9811]: cluster 2021-01-27T16:36:11.314687+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v90: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:14.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: cluster 2021-01-27T16:36:13.315151+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:14.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: audit 2021-01-27T16:36:13.466851+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2106736821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: audit 2021-01-27T16:36:13.467476+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: audit 2021-01-27T16:36:13.480107+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]': finished 2021-01-27T16:36:14.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: cluster 2021-01-27T16:36:13.480275+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T16:36:14.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: audit 2021-01-27T16:36:13.480577+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:14.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[13484]: audit 2021-01-27T16:36:14.124007+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/2672106080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:14.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: cluster 2021-01-27T16:36:13.315151+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: audit 2021-01-27T16:36:13.466851+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2106736821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: audit 2021-01-27T16:36:13.467476+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: audit 2021-01-27T16:36:13.480107+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]': finished 2021-01-27T16:36:14.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: cluster 2021-01-27T16:36:13.480275+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T16:36:14.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: audit 2021-01-27T16:36:13.480577+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:14.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:14 smithi106 bash[9795]: audit 2021-01-27T16:36:14.124007+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/2672106080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:14.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: cluster 2021-01-27T16:36:13.315151+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:14.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: audit 2021-01-27T16:36:13.466851+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.106:0/2106736821' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: audit 2021-01-27T16:36:13.467476+0000 mon.a (mon.0) 303 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]: dispatch 2021-01-27T16:36:14.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: audit 2021-01-27T16:36:13.480107+0000 mon.a (mon.0) 304 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3312df2-156f-4ecf-81b4-7b5cc0fabd9d"}]': finished 2021-01-27T16:36:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: cluster 2021-01-27T16:36:13.480275+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-27T16:36:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: audit 2021-01-27T16:36:13.480577+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:14.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:14 smithi094 bash[9811]: audit 2021-01-27T16:36:14.124007+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.106:0/2672106080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:15.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[9795]: cluster 2021-01-27T16:36:15.315821+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:15.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[9795]: cluster 2021-01-27T16:36:15.370935+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T16:36:15.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[9795]: cluster 2021-01-27T16:36:15.371016+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-27T16:36:15.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[13484]: cluster 2021-01-27T16:36:15.315821+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:15.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[13484]: cluster 2021-01-27T16:36:15.370935+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T16:36:15.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:15 smithi106 bash[13484]: cluster 2021-01-27T16:36:15.371016+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-27T16:36:15.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:15 smithi094 bash[9811]: cluster 2021-01-27T16:36:15.315821+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:15.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:15 smithi094 bash[9811]: cluster 2021-01-27T16:36:15.370935+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-27T16:36:15.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:15 smithi094 bash[9811]: cluster 2021-01-27T16:36:15.371016+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-27T16:36:18.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:17 smithi106 bash[9795]: audit 2021-01-27T16:36:17.251624+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:18.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:17 smithi106 bash[9795]: cluster 2021-01-27T16:36:17.316399+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:18.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:17 smithi106 bash[13484]: audit 2021-01-27T16:36:17.251624+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:18.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:17 smithi106 bash[13484]: cluster 2021-01-27T16:36:17.316399+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:18.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:17 smithi094 bash[9811]: audit 2021-01-27T16:36:17.251624+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:18.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:17 smithi094 bash[9811]: cluster 2021-01-27T16:36:17.316399+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:20.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:20 smithi106 bash[13484]: cluster 2021-01-27T16:36:19.316913+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:20.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:20 smithi106 bash[9795]: cluster 2021-01-27T16:36:19.316913+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:20.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:20 smithi094 bash[9811]: cluster 2021-01-27T16:36:19.316913+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:22.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[9795]: cluster 2021-01-27T16:36:21.317466+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:22.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[9795]: audit 2021-01-27T16:36:21.650241+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T16:36:22.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[9795]: audit 2021-01-27T16:36:21.651795+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:22.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[9795]: audit 2021-01-27T16:36:21.653852+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T16:36:22.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[13484]: cluster 2021-01-27T16:36:21.317466+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:22.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[13484]: audit 2021-01-27T16:36:21.650241+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T16:36:22.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[13484]: audit 2021-01-27T16:36:21.651795+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:22.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:22 smithi106 bash[13484]: audit 2021-01-27T16:36:21.653852+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T16:36:22.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:22 smithi094 bash[9811]: cluster 2021-01-27T16:36:21.317466+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:22.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:22 smithi094 bash[9811]: audit 2021-01-27T16:36:21.650241+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-27T16:36:22.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:22 smithi094 bash[9811]: audit 2021-01-27T16:36:21.651795+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:22.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:22 smithi094 bash[9811]: audit 2021-01-27T16:36:21.653852+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-27T16:36:23.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:23 smithi106 bash[9795]: cephadm 2021-01-27T16:36:21.653038+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi106 2021-01-27T16:36:23.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:23 smithi106 bash[13484]: cephadm 2021-01-27T16:36:21.653038+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi106 2021-01-27T16:36:23.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:23 smithi094 bash[9811]: cephadm 2021-01-27T16:36:21.653038+0000 mgr.y (mgr.14138) 128 : cephadm [INF] Deploying daemon osd.2 on smithi106 2021-01-27T16:36:24.380 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 2 on host 'smithi106' 2021-01-27T16:36:24.735 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[9795]: cluster 2021-01-27T16:36:23.318164+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:24.736 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[9795]: audit 2021-01-27T16:36:24.379877+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:24.736 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[9795]: audit 2021-01-27T16:36:24.384166+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:24.736 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[13484]: cluster 2021-01-27T16:36:23.318164+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:24.737 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[13484]: audit 2021-01-27T16:36:24.379877+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:24.737 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:24 smithi106 bash[13484]: audit 2021-01-27T16:36:24.384166+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:24.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:24 smithi094 bash[9811]: cluster 2021-01-27T16:36:23.318164+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:24.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:24 smithi094 bash[9811]: audit 2021-01-27T16:36:24.379877+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:24.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:24 smithi094 bash[9811]: audit 2021-01-27T16:36:24.384166+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:25.698 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:36:25 smithi106 bash[10032]: debug 2021-01-27T16:36:25.289+0000 7f0a44ff8700 -1 calc_pg_upmaps abort due to max <= 0 2021-01-27T16:36:26.376 DEBUG:teuthology.orchestra.run.smithi106:osd.2> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.2.service 2021-01-27T16:36:26.379 INFO:tasks.cephadm:Deploying osd.3 on smithi106 with /dev/vg_nvme/lv_1... 2021-01-27T16:36:26.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T16:36:26.407 INFO:journalctl@ceph.osd.2.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:36:26.763 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[9795]: cluster 2021-01-27T16:36:25.318843+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:26.764 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[9795]: audit 2021-01-27T16:36:25.431268+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:26.764 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[9795]: audit 2021-01-27T16:36:25.433036+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:26.764 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[9795]: audit 2021-01-27T16:36:25.472382+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:36:26.764 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[9795]: audit 2021-01-27T16:36:25.475146+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:36:26.765 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[13484]: cluster 2021-01-27T16:36:25.318843+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:26.765 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[13484]: audit 2021-01-27T16:36:25.431268+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:26.765 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[13484]: audit 2021-01-27T16:36:25.433036+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:26.765 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[13484]: audit 2021-01-27T16:36:25.472382+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:36:26.766 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:26 smithi106 bash[13484]: audit 2021-01-27T16:36:25.475146+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:36:26.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:26 smithi094 bash[9811]: cluster 2021-01-27T16:36:25.318843+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:26.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:26 smithi094 bash[9811]: audit 2021-01-27T16:36:25.431268+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:26.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:26 smithi094 bash[9811]: audit 2021-01-27T16:36:25.433036+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:26.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:26 smithi094 bash[9811]: audit 2021-01-27T16:36:25.472382+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:36:26.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:26 smithi094 bash[9811]: audit 2021-01-27T16:36:25.475146+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:36:27.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[13484]: cluster 2021-01-27T16:36:27.319306+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:27.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[9795]: cluster 2021-01-27T16:36:27.319306+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:27.949 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T16:36:27.949 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-01-27T16:36:27.950 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-01-27T16:36:27.950 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-01-27T16:36:27.950 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T16:36:27.950 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-27T16:36:27.951 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:27 smithi106 bash[21202]: --> ceph-volume lvm activate successful for osd ID: 2 2021-01-27T16:36:28.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:27 smithi094 bash[9811]: cluster 2021-01-27T16:36:27.319306+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:30.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:30 smithi106 bash[9795]: cluster 2021-01-27T16:36:29.319838+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:30.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:30 smithi106 bash[13484]: cluster 2021-01-27T16:36:29.319838+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:30.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:30 smithi094 bash[9811]: cluster 2021-01-27T16:36:29.319838+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:32.198 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 msgr2=0x55a9d2ca7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:36:32.199 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 msgr2=0x55a9d2ca7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:36:32.199 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_read_frame_preamble_main r=0 2021-01-27T16:36:32.199 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_MESSAGE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).throttle_message 2021-01-27T16:36:32.199 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_BYTES pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).throttle_bytes 2021-01-27T16:36:32.200 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).throttle_dispatch_queue 2021-01-27T16:36:32.200 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).read_frame_segment seg_idx=0 2021-01-27T16:36:32.200 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).read_frame_segment seg_idx=1 2021-01-27T16:36:32.200 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 msgr2=0x55a9d2ca7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:36:32.201 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_read_frame_segment r=0 2021-01-27T16:36:32.201 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 msgr2=0x55a9d2ca7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:36:32.201 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_read_frame_epilogue_main r=0 2021-01-27T16:36:32.201 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 10 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_read_frame_dispatch tag=17 2021-01-27T16:36:32.202 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_message 2021-01-27T16:36:32.202 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 5 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-27T16:36:32.202 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 5 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).handle_message received message m=0x55a9d2cbc4e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:36:32.202 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 queue 0x55a9d2cbc4e0 prio 196 2021-01-27T16:36:32.202 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 --2- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 0x55a9d2ca7400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x55a9d2cb7ec0 tx=0x55a9d2cecd80).read_frame 2021-01-27T16:36:32.203 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68fa6a1700 20 -- 172.21.15.106:0/3499240496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9d2d3ac00 msgr2=0x55a9d2ca7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:36:32.203 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68f969f700 1 -- 172.21.15.106:0/3499240496 <== mon.0 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a9d2cbc4e0 con 0x55a9d2d3ac00 2021-01-27T16:36:32.203 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68f969f700 10 -- 172.21.15.106:0/3499240496 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:36:32.203 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.049+0000 7f68f969f700 20 -- 172.21.15.106:0/3499240496 done calling dispatch on 0x55a9d2cbc4e0 2021-01-27T16:36:32.554 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[9795]: cluster 2021-01-27T16:36:31.320381+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:32.555 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[13484]: cluster 2021-01-27T16:36:31.320381+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:32 smithi094 bash[9811]: cluster 2021-01-27T16:36:31.320381+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:32.948 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:32 smithi106 bash[21560]: debug 2021-01-27T16:36:32.617+0000 7f690112a200 -1 Falling back to public interface 2021-01-27T16:36:33.145 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T16:36:33.146 INFO:teuthology.orchestra.run.smithi106.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T16:36:33.146 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10+0 records in 2021-01-27T16:36:33.146 INFO:teuthology.orchestra.run.smithi106.stderr:10+0 records out 2021-01-27T16:36:33.147 INFO:teuthology.orchestra.run.smithi106.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0178735 s, 587 MB/s 2021-01-27T16:36:33.147 INFO:teuthology.orchestra.run.smithi106.stderr:--> Zapping successful for: 2021-01-27T16:36:34.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi106:vg_nvme/lv_1 2021-01-27T16:36:34.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:34 smithi106 bash[9795]: cluster 2021-01-27T16:36:33.320793+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:34.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:34 smithi106 bash[13484]: cluster 2021-01-27T16:36:33.320793+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:34.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:34 smithi094 bash[9811]: cluster 2021-01-27T16:36:33.320793+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:35.670 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[9795]: audit 2021-01-27T16:36:34.978141+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:35.670 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[9795]: audit 2021-01-27T16:36:35.345103+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.671 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[9795]: audit 2021-01-27T16:36:35.349468+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.671 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[13484]: audit 2021-01-27T16:36:34.978141+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:35.671 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[13484]: audit 2021-01-27T16:36:35.345103+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.671 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[13484]: audit 2021-01-27T16:36:35.349468+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:35 smithi094 bash[9811]: audit 2021-01-27T16:36:34.978141+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:35.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:35 smithi094 bash[9811]: audit 2021-01-27T16:36:35.345103+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:35 smithi094 bash[9811]: audit 2021-01-27T16:36:35.349468+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:35.948 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:35 smithi106 bash[21560]: debug 2021-01-27T16:36:35.673+0000 7f690112a200 -1 osd.2 0 log_to_monitors {default=true} 2021-01-27T16:36:36.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: cluster 2021-01-27T16:36:35.321313+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:36.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: cephadm 2021-01-27T16:36:35.350509+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: cephadm 2021-01-27T16:36:35.351967+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:36:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: audit 2021-01-27T16:36:35.679949+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: audit 2021-01-27T16:36:35.680348+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[13484]: audit 2021-01-27T16:36:35.748919+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:36.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: cluster 2021-01-27T16:36:35.321313+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:36.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: cephadm 2021-01-27T16:36:35.350509+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:36.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: cephadm 2021-01-27T16:36:35.351967+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:36:36.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: audit 2021-01-27T16:36:35.679949+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: audit 2021-01-27T16:36:35.680348+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:36 smithi106 bash[9795]: audit 2021-01-27T16:36:35.748919+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:36.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: cluster 2021-01-27T16:36:35.321313+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:36.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: cephadm 2021-01-27T16:36:35.350509+0000 mgr.y (mgr.14138) 136 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:36.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: cephadm 2021-01-27T16:36:35.351967+0000 mgr.y (mgr.14138) 137 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:36:36.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: audit 2021-01-27T16:36:35.679949+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: audit 2021-01-27T16:36:35.680348+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-27T16:36:36.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:36 smithi094 bash[9811]: audit 2021-01-27T16:36:35.748919+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:37.698 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[21560]: debug 2021-01-27T16:36:37.417+0000 7f68f769b700 -1 osd.2 0 waiting for initial osdmap 2021-01-27T16:36:37.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: cephadm 2021-01-27T16:36:35.750213+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:37.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: audit 2021-01-27T16:36:36.404715+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T16:36:37.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: cluster 2021-01-27T16:36:36.404832+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T16:36:37.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: audit 2021-01-27T16:36:36.405098+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:37.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: audit 2021-01-27T16:36:36.406605+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:37.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[9795]: audit 2021-01-27T16:36:36.407079+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:37.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: cephadm 2021-01-27T16:36:35.750213+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:37.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: audit 2021-01-27T16:36:36.404715+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T16:36:37.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: cluster 2021-01-27T16:36:36.404832+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T16:36:37.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: audit 2021-01-27T16:36:36.405098+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:37.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: audit 2021-01-27T16:36:36.406605+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:37.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:37 smithi106 bash[13484]: audit 2021-01-27T16:36:36.407079+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: cephadm 2021-01-27T16:36:35.750213+0000 mgr.y (mgr.14138) 138 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:36:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: audit 2021-01-27T16:36:36.404715+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-27T16:36:37.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: cluster 2021-01-27T16:36:36.404832+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-27T16:36:37.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: audit 2021-01-27T16:36:36.405098+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:37.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: audit 2021-01-27T16:36:36.406605+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:37.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:37 smithi094 bash[9811]: audit 2021-01-27T16:36:36.407079+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:36:38.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: cluster 2021-01-27T16:36:37.321827+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:38.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.410108+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:38.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: cluster 2021-01-27T16:36:37.410411+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T16:36:38.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.411382+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.418232+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.864881+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:38.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.867937+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:38.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.869706+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:38.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[9795]: audit 2021-01-27T16:36:37.871804+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:38.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: cluster 2021-01-27T16:36:37.321827+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:38.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.410108+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:38.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: cluster 2021-01-27T16:36:37.410411+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T16:36:38.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.411382+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.418232+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.864881+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:38.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.867937+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:38.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.869706+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:38.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:38 smithi106 bash[13484]: audit 2021-01-27T16:36:37.871804+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:38.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: cluster 2021-01-27T16:36:37.321827+0000 mgr.y (mgr.14138) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:38.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.410108+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:36:38.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: cluster 2021-01-27T16:36:37.410411+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-27T16:36:38.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.411382+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.418232+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:38.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.864881+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:36:38.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.867937+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:36:38.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.869706+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:38.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:38 smithi094 bash[9811]: audit 2021-01-27T16:36:37.871804+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:39.663 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: cluster 2021-01-27T16:36:36.683260+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:39.663 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: cluster 2021-01-27T16:36:36.683534+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:39.663 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: audit 2021-01-27T16:36:37.862836+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:39.664 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: cephadm 2021-01-27T16:36:37.867323+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:39.664 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: audit 2021-01-27T16:36:38.423099+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:39.664 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: cluster 2021-01-27T16:36:38.432967+0000 mon.a (mon.0) 337 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:36:39.664 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: cluster 2021-01-27T16:36:38.433055+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T16:36:39.665 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[9795]: audit 2021-01-27T16:36:38.433279+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:39.665 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: cluster 2021-01-27T16:36:36.683260+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:39.665 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: cluster 2021-01-27T16:36:36.683534+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:39.665 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: audit 2021-01-27T16:36:37.862836+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:39.666 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: cephadm 2021-01-27T16:36:37.867323+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:39.666 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: audit 2021-01-27T16:36:38.423099+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:39.666 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: cluster 2021-01-27T16:36:38.432967+0000 mon.a (mon.0) 337 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:36:39.666 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: cluster 2021-01-27T16:36:38.433055+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T16:36:39.667 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:39 smithi106 bash[13484]: audit 2021-01-27T16:36:38.433279+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:39.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: cluster 2021-01-27T16:36:36.683260+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:36:39.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: cluster 2021-01-27T16:36:36.683534+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:36:39.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: audit 2021-01-27T16:36:37.862836+0000 mgr.y (mgr.14138) 140 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:36:39.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: cephadm 2021-01-27T16:36:37.867323+0000 mgr.y (mgr.14138) 141 : cephadm [INF] Applying drive group None on host smithi106... 2021-01-27T16:36:39.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: audit 2021-01-27T16:36:38.423099+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:39.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: cluster 2021-01-27T16:36:38.432967+0000 mon.a (mon.0) 337 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:36:39.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: cluster 2021-01-27T16:36:38.433055+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-27T16:36:39.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:39 smithi094 bash[9811]: audit 2021-01-27T16:36:38.433279+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:36:40.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:40 smithi106 bash[13484]: cluster 2021-01-27T16:36:39.322365+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:40.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:40 smithi106 bash[13484]: cluster 2021-01-27T16:36:39.439620+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T16:36:40.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:40 smithi106 bash[9795]: cluster 2021-01-27T16:36:39.322365+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:40.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:40 smithi106 bash[9795]: cluster 2021-01-27T16:36:39.439620+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T16:36:40.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:40 smithi094 bash[9811]: cluster 2021-01-27T16:36:39.322365+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v108: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-27T16:36:40.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:40 smithi094 bash[9811]: cluster 2021-01-27T16:36:39.439620+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-27T16:36:41.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:41 smithi106 bash[9795]: cluster 2021-01-27T16:36:41.322930+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:41.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:41 smithi106 bash[13484]: cluster 2021-01-27T16:36:41.322930+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:41.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:41 smithi094 bash[9811]: cluster 2021-01-27T16:36:41.322930+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:43.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: audit 2021-01-27T16:36:42.109568+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/429592678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: audit 2021-01-27T16:36:42.110199+0000 mon.a (mon.0) 341 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: audit 2021-01-27T16:36:42.118734+0000 mon.a (mon.0) 342 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]': finished 2021-01-27T16:36:43.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: cluster 2021-01-27T16:36:42.118970+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T16:36:43.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: audit 2021-01-27T16:36:42.119267+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:36:43.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[9795]: audit 2021-01-27T16:36:42.750918+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.106:0/3367674915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:43.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: audit 2021-01-27T16:36:42.109568+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/429592678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: audit 2021-01-27T16:36:42.110199+0000 mon.a (mon.0) 341 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: audit 2021-01-27T16:36:42.118734+0000 mon.a (mon.0) 342 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]': finished 2021-01-27T16:36:43.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: cluster 2021-01-27T16:36:42.118970+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T16:36:43.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: audit 2021-01-27T16:36:42.119267+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:36:43.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:42 smithi106 bash[13484]: audit 2021-01-27T16:36:42.750918+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.106:0/3367674915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:43.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: audit 2021-01-27T16:36:42.109568+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.106:0/429592678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: audit 2021-01-27T16:36:42.110199+0000 mon.a (mon.0) 341 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]: dispatch 2021-01-27T16:36:43.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: audit 2021-01-27T16:36:42.118734+0000 mon.a (mon.0) 342 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3482f065-fb56-419b-9661-976fe0fe2a91"}]': finished 2021-01-27T16:36:43.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: cluster 2021-01-27T16:36:42.118970+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-27T16:36:43.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: audit 2021-01-27T16:36:42.119267+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:36:43.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:42 smithi094 bash[9811]: audit 2021-01-27T16:36:42.750918+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.15.106:0/3367674915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:36:44.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:43 smithi106 bash[9795]: cluster 2021-01-27T16:36:43.323607+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:44.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:43 smithi106 bash[13484]: cluster 2021-01-27T16:36:43.323607+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:44.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:43 smithi094 bash[9811]: cluster 2021-01-27T16:36:43.323607+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:46.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:46 smithi106 bash[9795]: cluster 2021-01-27T16:36:45.324190+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:46.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:46 smithi106 bash[9795]: audit 2021-01-27T16:36:45.961025+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:46.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:46 smithi106 bash[13484]: cluster 2021-01-27T16:36:45.324190+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:46.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:46 smithi106 bash[13484]: audit 2021-01-27T16:36:45.961025+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:46.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:46 smithi094 bash[9811]: cluster 2021-01-27T16:36:45.324190+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:46.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:46 smithi094 bash[9811]: audit 2021-01-27T16:36:45.961025+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:48.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:47 smithi106 bash[13484]: cluster 2021-01-27T16:36:47.324741+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:48.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:47 smithi106 bash[9795]: cluster 2021-01-27T16:36:47.324741+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:48.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:47 smithi094 bash[9811]: cluster 2021-01-27T16:36:47.324741+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:50.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:50 smithi106 bash[9795]: cluster 2021-01-27T16:36:49.325185+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:50.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:50 smithi106 bash[13484]: cluster 2021-01-27T16:36:49.325185+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:50.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:50 smithi094 bash[9811]: cluster 2021-01-27T16:36:49.325185+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[9795]: audit 2021-01-27T16:36:50.665019+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T16:36:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[9795]: audit 2021-01-27T16:36:50.666769+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[9795]: audit 2021-01-27T16:36:50.669006+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T16:36:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[13484]: audit 2021-01-27T16:36:50.665019+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T16:36:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[13484]: audit 2021-01-27T16:36:50.666769+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:51 smithi106 bash[13484]: audit 2021-01-27T16:36:50.669006+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T16:36:51.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:51 smithi094 bash[9811]: audit 2021-01-27T16:36:50.665019+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-27T16:36:51.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:51 smithi094 bash[9811]: audit 2021-01-27T16:36:50.666769+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:36:51.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:51 smithi094 bash[9811]: audit 2021-01-27T16:36:50.669006+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-27T16:36:52.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:52 smithi106 bash[9795]: cephadm 2021-01-27T16:36:50.668209+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi106 2021-01-27T16:36:52.448 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:52 smithi106 bash[9795]: cluster 2021-01-27T16:36:51.325743+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:52.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:52 smithi106 bash[13484]: cephadm 2021-01-27T16:36:50.668209+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi106 2021-01-27T16:36:52.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:52 smithi106 bash[13484]: cluster 2021-01-27T16:36:51.325743+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:52.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:52 smithi094 bash[9811]: cephadm 2021-01-27T16:36:50.668209+0000 mgr.y (mgr.14138) 148 : cephadm [INF] Deploying daemon osd.3 on smithi106 2021-01-27T16:36:52.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:52 smithi094 bash[9811]: cluster 2021-01-27T16:36:51.325743+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:53.604 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 3 on host 'smithi106' 2021-01-27T16:36:54.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[13484]: cluster 2021-01-27T16:36:53.326386+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:54.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[13484]: audit 2021-01-27T16:36:53.603527+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:54.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[13484]: audit 2021-01-27T16:36:53.606537+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:54.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[9795]: cluster 2021-01-27T16:36:53.326386+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:54.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[9795]: audit 2021-01-27T16:36:53.603527+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:54.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:54 smithi106 bash[9795]: audit 2021-01-27T16:36:53.606537+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:54.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:54 smithi094 bash[9811]: cluster 2021-01-27T16:36:53.326386+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:54.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:54 smithi094 bash[9811]: audit 2021-01-27T16:36:53.603527+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:36:54.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:54 smithi094 bash[9811]: audit 2021-01-27T16:36:53.606537+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:55.218 DEBUG:teuthology.orchestra.run.smithi106:osd.3> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.3.service 2021-01-27T16:36:55.224 INFO:tasks.cephadm:Deploying osd.4 on smithi094 with /dev/vg_nvme/lv_4... 2021-01-27T16:36:55.225 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-27T16:36:55.333 INFO:journalctl@ceph.osd.3.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:36:56.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:55 smithi094 bash[9811]: audit 2021-01-27T16:36:54.728755+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:56.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:55 smithi094 bash[9811]: audit 2021-01-27T16:36:54.730309+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:56.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:55 smithi094 bash[9811]: cluster 2021-01-27T16:36:55.327004+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:56.051 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[9795]: audit 2021-01-27T16:36:54.728755+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:56.051 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[9795]: audit 2021-01-27T16:36:54.730309+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:56.051 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[9795]: cluster 2021-01-27T16:36:55.327004+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:56.051 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[13484]: audit 2021-01-27T16:36:54.728755+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:36:56.052 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[13484]: audit 2021-01-27T16:36:54.730309+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:36:56.052 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:55 smithi106 bash[13484]: cluster 2021-01-27T16:36:55.327004+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:56.697 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T16:36:56.698 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-01-27T16:36:56.698 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-01-27T16:36:56.698 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-01-27T16:36:56.699 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T16:36:56.699 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-27T16:36:56.699 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:56 smithi106 bash[23700]: --> ceph-volume lvm activate successful for osd ID: 3 2021-01-27T16:36:58.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:36:57 smithi106 bash[9795]: cluster 2021-01-27T16:36:57.327592+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:58.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:36:57 smithi106 bash[13484]: cluster 2021-01-27T16:36:57.327592+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:58.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:36:57 smithi094 bash[9811]: cluster 2021-01-27T16:36:57.327592+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:36:59.048 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-27T16:36:59.048 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-27T16:36:59.048 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2021-01-27T16:36:59.048 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2021-01-27T16:36:59.049 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0158216 s, 663 MB/s 2021-01-27T16:36:59.049 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2021-01-27T16:36:59.448 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 msgr2=0x555d0015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:36:59.448 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 msgr2=0x555d0015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:36:59.448 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_read_frame_preamble_main r=0 2021-01-27T16:36:59.449 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_MESSAGE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).throttle_message 2021-01-27T16:36:59.449 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_BYTES pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).throttle_bytes 2021-01-27T16:36:59.449 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).throttle_dispatch_queue 2021-01-27T16:36:59.449 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).read_frame_segment seg_idx=0 2021-01-27T16:36:59.449 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).read_frame_segment seg_idx=1 2021-01-27T16:36:59.450 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 msgr2=0x555d0015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:36:59.450 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_read_frame_segment r=0 2021-01-27T16:36:59.450 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 msgr2=0x555d0015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:36:59.450 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_read_frame_epilogue_main r=0 2021-01-27T16:36:59.451 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 10 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_read_frame_dispatch tag=17 2021-01-27T16:36:59.451 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_message 2021-01-27T16:36:59.451 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 5 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-27T16:36:59.451 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 5 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).handle_message received message m=0x555d001704e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:36:59.452 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 queue 0x555d001704e0 prio 196 2021-01-27T16:36:59.452 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 --2- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 0x555d0015be00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x555d0016be60 tx=0x555d001a00c0).read_frame 2021-01-27T16:36:59.452 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b8097700 20 -- 172.21.15.106:0/3080109617 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555d001ef000 msgr2=0x555d0015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:36:59.452 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b7896700 1 -- 172.21.15.106:0/3080109617 <== mon.1 v2:172.21.15.106:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555d001704e0 con 0x555d001ef000 2021-01-27T16:36:59.452 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b7896700 10 -- 172.21.15.106:0/3080109617 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:36:59.453 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.097+0000 7f81b7896700 20 -- 172.21.15.106:0/3080109617 done calling dispatch on 0x555d001704e0 2021-01-27T16:36:59.904 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi094:vg_nvme/lv_4 2021-01-27T16:36:59.947 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:36:59 smithi106 bash[24045]: debug 2021-01-27T16:36:59.645+0000 7f81bf321200 -1 Falling back to public interface 2021-01-27T16:37:00.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:00 smithi094 bash[9811]: cluster 2021-01-27T16:36:59.328105+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:00.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:00 smithi106 bash[9795]: cluster 2021-01-27T16:36:59.328105+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:00.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:00 smithi106 bash[13484]: cluster 2021-01-27T16:36:59.328105+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:01.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:01 smithi094 bash[9811]: audit 2021-01-27T16:37:01.378772+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:01.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:01 smithi106 bash[13484]: audit 2021-01-27T16:37:01.378772+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:01.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:01 smithi106 bash[9795]: audit 2021-01-27T16:37:01.378772+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:02.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:02 smithi094 bash[9811]: cluster 2021-01-27T16:37:01.328680+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:02.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:02 smithi094 bash[9811]: audit 2021-01-27T16:37:01.750839+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:02 smithi094 bash[9811]: audit 2021-01-27T16:37:01.759267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:02 smithi094 bash[9811]: audit 2021-01-27T16:37:01.768529+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.660 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[9795]: cluster 2021-01-27T16:37:01.328680+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:02.660 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[9795]: audit 2021-01-27T16:37:01.750839+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.660 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[9795]: audit 2021-01-27T16:37:01.759267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.660 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[9795]: audit 2021-01-27T16:37:01.768529+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.661 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[13484]: cluster 2021-01-27T16:37:01.328680+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:02.661 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[13484]: audit 2021-01-27T16:37:01.750839+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.661 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[13484]: audit 2021-01-27T16:37:01.759267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.661 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[13484]: audit 2021-01-27T16:37:01.768529+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:02.947 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:37:02 smithi106 bash[24045]: debug 2021-01-27T16:37:02.661+0000 7f81bf321200 -1 osd.3 0 log_to_monitors {default=true} 2021-01-27T16:37:03.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:03 smithi094 bash[9811]: cephadm 2021-01-27T16:37:01.760512+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:03 smithi094 bash[9811]: cephadm 2021-01-27T16:37:01.769504+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:03 smithi094 bash[9811]: audit 2021-01-27T16:37:02.670025+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:03.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:03 smithi094 bash[9811]: audit 2021-01-27T16:37:02.670642+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:03.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[9795]: cephadm 2021-01-27T16:37:01.760512+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[9795]: cephadm 2021-01-27T16:37:01.769504+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[9795]: audit 2021-01-27T16:37:02.670025+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:03.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[9795]: audit 2021-01-27T16:37:02.670642+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:03.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[13484]: cephadm 2021-01-27T16:37:01.760512+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[13484]: cephadm 2021-01-27T16:37:01.769504+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:03.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[13484]: audit 2021-01-27T16:37:02.670025+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:03.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:03 smithi106 bash[13484]: audit 2021-01-27T16:37:02.670642+0000 mon.a (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-27T16:37:04.697 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[24045]: debug 2021-01-27T16:37:04.421+0000 7f81b5892700 -1 osd.3 0 waiting for initial osdmap 2021-01-27T16:37:04.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: cluster 2021-01-27T16:37:03.329318+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:04.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.414452+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T16:37:04.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: cluster 2021-01-27T16:37:03.414614+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T16:37:04.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.415089+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:04.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.416037+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.416535+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.621015+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:04.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.624905+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:04.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.626726+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:04.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[9795]: audit 2021-01-27T16:37:03.629077+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:04.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: cluster 2021-01-27T16:37:03.329318+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:04.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.414452+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T16:37:04.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: cluster 2021-01-27T16:37:03.414614+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T16:37:04.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.415089+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:04.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.416037+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.416535+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.621015+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:04.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.624905+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:04.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.626726+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:04.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:04 smithi106 bash[13484]: audit 2021-01-27T16:37:03.629077+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: cluster 2021-01-27T16:37:03.329318+0000 mgr.y (mgr.14138) 157 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.414452+0000 mon.a (mon.0) 359 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-27T16:37:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: cluster 2021-01-27T16:37:03.414614+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-27T16:37:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.415089+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.416037+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.416535+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]: dispatch 2021-01-27T16:37:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.621015+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.624905+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:04.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.626726+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:04.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:04 smithi094 bash[9811]: audit 2021-01-27T16:37:03.629077+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:05.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: audit 2021-01-27T16:37:03.618955+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:05.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: cephadm 2021-01-27T16:37:03.624307+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:05.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: audit 2021-01-27T16:37:04.416262+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:37:05.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: cluster 2021-01-27T16:37:04.416473+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T16:37:05.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: audit 2021-01-27T16:37:04.417208+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:05.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[9795]: audit 2021-01-27T16:37:04.425315+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: audit 2021-01-27T16:37:03.618955+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: cephadm 2021-01-27T16:37:03.624307+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: audit 2021-01-27T16:37:04.416262+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:37:05.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: cluster 2021-01-27T16:37:04.416473+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T16:37:05.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: audit 2021-01-27T16:37:04.417208+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:05.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:05 smithi106 bash[13484]: audit 2021-01-27T16:37:04.425315+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: audit 2021-01-27T16:37:03.618955+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: cephadm 2021-01-27T16:37:03.624307+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: audit 2021-01-27T16:37:04.416262+0000 mon.a (mon.0) 367 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2021-01-27T16:37:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: cluster 2021-01-27T16:37:04.416473+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-27T16:37:05.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: audit 2021-01-27T16:37:04.417208+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:05.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:05 smithi094 bash[9811]: audit 2021-01-27T16:37:04.425315+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:06.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: cluster 2021-01-27T16:37:03.637482+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: cluster 2021-01-27T16:37:03.637659+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: cluster 2021-01-27T16:37:05.329921+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: cluster 2021-01-27T16:37:05.427946+0000 mon.a (mon.0) 371 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:37:06.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: cluster 2021-01-27T16:37:05.428085+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T16:37:06.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[9795]: audit 2021-01-27T16:37:05.428916+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: cluster 2021-01-27T16:37:03.637482+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: cluster 2021-01-27T16:37:03.637659+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: cluster 2021-01-27T16:37:05.329921+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: cluster 2021-01-27T16:37:05.427946+0000 mon.a (mon.0) 371 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:37:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: cluster 2021-01-27T16:37:05.428085+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T16:37:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:06 smithi106 bash[13484]: audit 2021-01-27T16:37:05.428916+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:06.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: cluster 2021-01-27T16:37:03.637482+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: cluster 2021-01-27T16:37:03.637659+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: cluster 2021-01-27T16:37:05.329921+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-27T16:37:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: cluster 2021-01-27T16:37:05.427946+0000 mon.a (mon.0) 371 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:37:06.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: cluster 2021-01-27T16:37:05.428085+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-27T16:37:06.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:06 smithi094 bash[9811]: audit 2021-01-27T16:37:05.428916+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:37:07.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:07 smithi094 bash[9811]: cluster 2021-01-27T16:37:06.445154+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T16:37:07.533 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:07 smithi094 bash[9811]: cluster 2021-01-27T16:37:07.330459+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:07.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:07 smithi106 bash[9795]: cluster 2021-01-27T16:37:06.445154+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T16:37:07.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:07 smithi106 bash[9795]: cluster 2021-01-27T16:37:07.330459+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:07.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:07 smithi106 bash[13484]: cluster 2021-01-27T16:37:06.445154+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-27T16:37:07.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:07 smithi106 bash[13484]: cluster 2021-01-27T16:37:07.330459+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:09.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: audit 2021-01-27T16:37:08.047946+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.94:0/4102607220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: audit 2021-01-27T16:37:08.050253+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: audit 2021-01-27T16:37:08.058665+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]': finished 2021-01-27T16:37:09.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: cluster 2021-01-27T16:37:08.058886+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T16:37:09.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: audit 2021-01-27T16:37:08.059183+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:09.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[9795]: audit 2021-01-27T16:37:08.723790+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.94:0/3616243053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:09.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: audit 2021-01-27T16:37:08.047946+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.94:0/4102607220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: audit 2021-01-27T16:37:08.050253+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: audit 2021-01-27T16:37:08.058665+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]': finished 2021-01-27T16:37:09.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: cluster 2021-01-27T16:37:08.058886+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T16:37:09.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: audit 2021-01-27T16:37:08.059183+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:09.200 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:08 smithi106 bash[13484]: audit 2021-01-27T16:37:08.723790+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.94:0/3616243053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:09.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: audit 2021-01-27T16:37:08.047946+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.94:0/4102607220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: audit 2021-01-27T16:37:08.050253+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]: dispatch 2021-01-27T16:37:09.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: audit 2021-01-27T16:37:08.058665+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bace9ab3-237b-4ed3-a0b8-fae82cac33b9"}]': finished 2021-01-27T16:37:09.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: cluster 2021-01-27T16:37:08.058886+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-27T16:37:09.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: audit 2021-01-27T16:37:08.059183+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:09.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:08 smithi094 bash[9811]: audit 2021-01-27T16:37:08.723790+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.94:0/3616243053' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:10.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:09 smithi106 bash[9795]: cluster 2021-01-27T16:37:09.331035+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:10.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:09 smithi106 bash[13484]: cluster 2021-01-27T16:37:09.331035+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:10.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:09 smithi094 bash[9811]: cluster 2021-01-27T16:37:09.331035+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:12.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:12 smithi106 bash[9795]: cluster 2021-01-27T16:37:11.331696+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:12.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:12 smithi106 bash[9795]: audit 2021-01-27T16:37:12.027025+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:12.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:12 smithi106 bash[13484]: cluster 2021-01-27T16:37:11.331696+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:12.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:12 smithi106 bash[13484]: audit 2021-01-27T16:37:12.027025+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:12.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:12 smithi094 bash[9811]: cluster 2021-01-27T16:37:11.331696+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:12.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:12 smithi094 bash[9811]: audit 2021-01-27T16:37:12.027025+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:14.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:14 smithi106 bash[9795]: cluster 2021-01-27T16:37:13.332235+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:14.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:14 smithi106 bash[13484]: cluster 2021-01-27T16:37:13.332235+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:14.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:14 smithi094 bash[9811]: cluster 2021-01-27T16:37:13.332235+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:16.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:16 smithi106 bash[9795]: cluster 2021-01-27T16:37:15.332840+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:16.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:16 smithi106 bash[13484]: cluster 2021-01-27T16:37:15.332840+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:16.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:16 smithi094 bash[9811]: cluster 2021-01-27T16:37:15.332840+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:17.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[9795]: audit 2021-01-27T16:37:16.672329+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T16:37:17.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[9795]: audit 2021-01-27T16:37:16.674358+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:17.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[9795]: audit 2021-01-27T16:37:16.677026+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T16:37:17.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[13484]: audit 2021-01-27T16:37:16.672329+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T16:37:17.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[13484]: audit 2021-01-27T16:37:16.674358+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:17.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:17 smithi106 bash[13484]: audit 2021-01-27T16:37:16.677026+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T16:37:17.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:17 smithi094 bash[9811]: audit 2021-01-27T16:37:16.672329+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-27T16:37:17.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:17 smithi094 bash[9811]: audit 2021-01-27T16:37:16.674358+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:17.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:17 smithi094 bash[9811]: audit 2021-01-27T16:37:16.677026+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-27T16:37:18.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:18 smithi106 bash[9795]: cephadm 2021-01-27T16:37:16.675988+0000 mgr.y (mgr.14138) 166 : cephadm [INF] Deploying daemon osd.4 on smithi094 2021-01-27T16:37:18.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:18 smithi106 bash[9795]: cluster 2021-01-27T16:37:17.333426+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:18.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:18 smithi106 bash[13484]: cephadm 2021-01-27T16:37:16.675988+0000 mgr.y (mgr.14138) 166 : cephadm [INF] Deploying daemon osd.4 on smithi094 2021-01-27T16:37:18.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:18 smithi106 bash[13484]: cluster 2021-01-27T16:37:17.333426+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:18.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:18 smithi094 bash[9811]: cephadm 2021-01-27T16:37:16.675988+0000 mgr.y (mgr.14138) 166 : cephadm [INF] Deploying daemon osd.4 on smithi094 2021-01-27T16:37:18.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:18 smithi094 bash[9811]: cluster 2021-01-27T16:37:17.333426+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:19.486 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 4 on host 'smithi094' 2021-01-27T16:37:20.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[9795]: cluster 2021-01-27T16:37:19.333919+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:20.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[9795]: audit 2021-01-27T16:37:19.483248+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:20.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[9795]: audit 2021-01-27T16:37:19.488332+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:20.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[13484]: cluster 2021-01-27T16:37:19.333919+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:20.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[13484]: audit 2021-01-27T16:37:19.483248+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:20.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:20 smithi106 bash[13484]: audit 2021-01-27T16:37:19.488332+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:20.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:20 smithi094 bash[9811]: cluster 2021-01-27T16:37:19.333919+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:20.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:20 smithi094 bash[9811]: audit 2021-01-27T16:37:19.483248+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:20.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:20 smithi094 bash[9811]: audit 2021-01-27T16:37:19.488332+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:21.380 DEBUG:teuthology.orchestra.run.smithi094:osd.4> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.4.service 2021-01-27T16:37:21.382 INFO:tasks.cephadm:Deploying osd.5 on smithi094 with /dev/vg_nvme/lv_3... 2021-01-27T16:37:21.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-27T16:37:21.505 INFO:journalctl@ceph.osd.4.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:37:21.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[9795]: cephadm 2021-01-27T16:37:19.481908+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:37:21.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[9795]: audit 2021-01-27T16:37:20.422379+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:21.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[9795]: audit 2021-01-27T16:37:20.423900+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:21.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[13484]: cephadm 2021-01-27T16:37:19.481908+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:37:21.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[13484]: audit 2021-01-27T16:37:20.422379+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:21.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:21 smithi106 bash[13484]: audit 2021-01-27T16:37:20.423900+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:21.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:21 smithi094 bash[9811]: cephadm 2021-01-27T16:37:19.481908+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:37:21.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:21 smithi094 bash[9811]: audit 2021-01-27T16:37:20.422379+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:21.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:21 smithi094 bash[9811]: audit 2021-01-27T16:37:20.423900+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:22.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:22 smithi106 bash[9795]: cluster 2021-01-27T16:37:21.334489+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:22.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:22 smithi106 bash[13484]: cluster 2021-01-27T16:37:21.334489+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:22.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[9811]: cluster 2021-01-27T16:37:21.334489+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:23.282 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T16:37:23.283 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-01-27T16:37:23.283 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-01-27T16:37:23.283 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-01-27T16:37:23.283 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-27T16:37:23.284 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-27T16:37:23.284 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:22 smithi094 bash[12318]: --> ceph-volume lvm activate successful for osd ID: 4 2021-01-27T16:37:23.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:23 smithi094 bash[9811]: cluster 2021-01-27T16:37:23.335074+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:23.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:23 smithi106 bash[9795]: cluster 2021-01-27T16:37:23.335074+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:23.947 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:23 smithi106 bash[13484]: cluster 2021-01-27T16:37:23.335074+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:26.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[9795]: cluster 2021-01-27T16:37:25.335685+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:26.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[9795]: audit 2021-01-27T16:37:25.474404+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:37:26.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[9795]: audit 2021-01-27T16:37:25.477013+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:37:26.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[13484]: cluster 2021-01-27T16:37:25.335685+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:26.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[13484]: audit 2021-01-27T16:37:25.474404+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:37:26.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:26 smithi106 bash[13484]: audit 2021-01-27T16:37:25.477013+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:37:26.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:26 smithi094 bash[9811]: cluster 2021-01-27T16:37:25.335685+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:26.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:26 smithi094 bash[9811]: audit 2021-01-27T16:37:25.474404+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:37:26.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:26 smithi094 bash[9811]: audit 2021-01-27T16:37:25.477013+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:37:27.782 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 10 --2- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 0x55d7fd1f8300 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55d7fd207e60 tx=0x55d7fd23cd80).handle_read_frame_dispatch tag=17 2021-01-27T16:37:27.783 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 20 --2- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 0x55d7fd1f8300 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55d7fd207e60 tx=0x55d7fd23cd80).handle_message 2021-01-27T16:37:27.783 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 5 --2- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 0x55d7fd1f8300 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55d7fd207e60 tx=0x55d7fd23cd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T16:37:27.783 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 5 --2- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 0x55d7fd1f8300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=14 cs=0 l=1 rev1=1 rx=0x55d7fd207e60 tx=0x55d7fd23cd80).handle_message received message m=0x55d7fd20c4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:37:27.783 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 20 -- 172.21.15.94:0/2930724351 queue 0x55d7fd20c4e0 prio 196 2021-01-27T16:37:27.784 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 20 --2- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 0x55d7fd1f8300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x55d7fd207e60 tx=0x55d7fd23cd80).read_frame 2021-01-27T16:37:27.784 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc02f22b700 1 -- 172.21.15.94:0/2930724351 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7fd20c4e0 con 0x55d7fd28b400 2021-01-27T16:37:27.784 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc030a2e700 20 -- 172.21.15.94:0/2930724351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55d7fd28b400 msgr2=0x55d7fd1f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:37:27.784 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc02f22b700 10 -- 172.21.15.94:0/2930724351 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:37:27.785 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[12635]: debug 2021-01-27T16:37:27.459+0000 7fc02f22b700 20 -- 172.21.15.94:0/2930724351 done calling dispatch on 0x55d7fd20c4e0 2021-01-27T16:37:28.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:27 smithi106 bash[9795]: cluster 2021-01-27T16:37:27.336263+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:28.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:27 smithi106 bash[13484]: cluster 2021-01-27T16:37:27.336263+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:28.281 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:27 smithi094 bash[9811]: cluster 2021-01-27T16:37:27.336263+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:28.281 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:28 smithi094 bash[12635]: debug 2021-01-27T16:37:28.007+0000 7fc036cb6200 -1 Falling back to public interface 2021-01-27T16:37:29.184 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-27T16:37:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-27T16:37:29.185 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2021-01-27T16:37:29.185 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2021-01-27T16:37:29.186 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121861 s, 860 MB/s 2021-01-27T16:37:29.186 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2021-01-27T16:37:30.225 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi094:vg_nvme/lv_3 2021-01-27T16:37:30.428 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:30 smithi094 bash[9811]: cluster 2021-01-27T16:37:29.336814+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:30.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:30 smithi106 bash[9795]: cluster 2021-01-27T16:37:29.336814+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:30.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:30 smithi106 bash[13484]: cluster 2021-01-27T16:37:29.336814+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:31.282 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:30 smithi094 bash[12635]: debug 2021-01-27T16:37:30.995+0000 7fc036cb6200 -1 osd.4 0 log_to_monitors {default=true} 2021-01-27T16:37:31.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:31 smithi106 bash[9795]: audit 2021-01-27T16:37:31.006491+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T16:37:31.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:31 smithi106 bash[9795]: audit 2021-01-27T16:37:31.276222+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:31.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:31 smithi106 bash[13484]: audit 2021-01-27T16:37:31.006491+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T16:37:31.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:31 smithi106 bash[13484]: audit 2021-01-27T16:37:31.276222+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:31.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:31 smithi094 bash[9811]: audit 2021-01-27T16:37:31.006491+0000 mon.a (mon.0) 389 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-27T16:37:31.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:31 smithi094 bash[9811]: audit 2021-01-27T16:37:31.276222+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:32.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: cluster 2021-01-27T16:37:31.337393+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:32.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.408868+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T16:37:32.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: cluster 2021-01-27T16:37:31.409022+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T16:37:32.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.409286+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:32.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.410334+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:37:32.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.646120+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.653634+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[9795]: audit 2021-01-27T16:37:31.661209+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: cluster 2021-01-27T16:37:31.337393+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:32.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.408868+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T16:37:32.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: cluster 2021-01-27T16:37:31.409022+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T16:37:32.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.409286+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:32.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.410334+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:37:32.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.646120+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.653634+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:32 smithi106 bash[13484]: audit 2021-01-27T16:37:31.661209+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.782 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[12635]: debug 2021-01-27T16:37:32.415+0000 7fc02d227700 -1 osd.4 0 waiting for initial osdmap 2021-01-27T16:37:32.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: cluster 2021-01-27T16:37:31.337393+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.408868+0000 mon.a (mon.0) 391 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-27T16:37:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: cluster 2021-01-27T16:37:31.409022+0000 mon.a (mon.0) 392 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-27T16:37:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.409286+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.410334+0000 mon.a (mon.0) 394 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:37:32.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.646120+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.653634+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:32.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:32 smithi094 bash[9811]: audit 2021-01-27T16:37:31.661209+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:33.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: cephadm 2021-01-27T16:37:31.654891+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: cephadm 2021-01-27T16:37:31.662737+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: audit 2021-01-27T16:37:32.411940+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:37:33.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: cluster 2021-01-27T16:37:32.412195+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T16:37:33.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: audit 2021-01-27T16:37:32.413362+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:33.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[9795]: audit 2021-01-27T16:37:32.421195+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:33.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: cephadm 2021-01-27T16:37:31.654891+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: cephadm 2021-01-27T16:37:31.662737+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: audit 2021-01-27T16:37:32.411940+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:37:33.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: cluster 2021-01-27T16:37:32.412195+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T16:37:33.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: audit 2021-01-27T16:37:32.413362+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:33.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:33 smithi106 bash[13484]: audit 2021-01-27T16:37:32.421195+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:33.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: cephadm 2021-01-27T16:37:31.654891+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: cephadm 2021-01-27T16:37:31.662737+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:37:33.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: audit 2021-01-27T16:37:32.411940+0000 mon.a (mon.0) 398 : audit [INF] from='osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131]' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:37:33.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: cluster 2021-01-27T16:37:32.412195+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-27T16:37:33.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: audit 2021-01-27T16:37:32.413362+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:33.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:33 smithi094 bash[9811]: audit 2021-01-27T16:37:32.421195+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:34.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:32.024100+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:34.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:32.024383+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:34.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:33.337936+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:34.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:33.419399+0000 mon.a (mon.0) 402 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:37:34.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:33.419510+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T16:37:34.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: audit 2021-01-27T16:37:33.419769+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:34.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: audit 2021-01-27T16:37:34.386272+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:34.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: audit 2021-01-27T16:37:34.389772+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:34.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: audit 2021-01-27T16:37:34.391614+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:34.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: audit 2021-01-27T16:37:34.393866+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:34.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[9795]: cluster 2021-01-27T16:37:34.416365+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T16:37:34.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:32.024100+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:34.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:32.024383+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:34.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:33.337936+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:34.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:33.419399+0000 mon.a (mon.0) 402 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:37:34.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:33.419510+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T16:37:34.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: audit 2021-01-27T16:37:33.419769+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:34.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: audit 2021-01-27T16:37:34.386272+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:34.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: audit 2021-01-27T16:37:34.389772+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:34.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: audit 2021-01-27T16:37:34.391614+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:34.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: audit 2021-01-27T16:37:34.393866+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:34.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:34 smithi106 bash[13484]: cluster 2021-01-27T16:37:34.416365+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T16:37:34.762 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:32.024100+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:37:34.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:32.024383+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:37:34.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:33.337936+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-27T16:37:34.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:33.419399+0000 mon.a (mon.0) 402 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:37:34.764 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:33.419510+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-27T16:37:34.764 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: audit 2021-01-27T16:37:33.419769+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:37:34.764 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: audit 2021-01-27T16:37:34.386272+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:37:34.765 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: audit 2021-01-27T16:37:34.389772+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:37:34.765 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: audit 2021-01-27T16:37:34.391614+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:34.765 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: audit 2021-01-27T16:37:34.393866+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:34.765 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:34 smithi094 bash[9811]: cluster 2021-01-27T16:37:34.416365+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-27T16:37:35.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:35 smithi106 bash[9795]: audit 2021-01-27T16:37:34.384096+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:35.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:35 smithi106 bash[9795]: cephadm 2021-01-27T16:37:34.389198+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:35 smithi106 bash[13484]: audit 2021-01-27T16:37:34.384096+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:35 smithi106 bash[13484]: cephadm 2021-01-27T16:37:34.389198+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:35.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:35 smithi094 bash[9811]: audit 2021-01-27T16:37:34.384096+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:37:35.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:35 smithi094 bash[9811]: cephadm 2021-01-27T16:37:34.389198+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:37:36.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:36 smithi094 bash[9811]: cluster 2021-01-27T16:37:35.338515+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:36.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:36 smithi106 bash[9795]: cluster 2021-01-27T16:37:35.338515+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:36.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:36 smithi106 bash[13484]: cluster 2021-01-27T16:37:35.338515+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:38.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:37 smithi106 bash[9795]: cluster 2021-01-27T16:37:37.339076+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:38.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:37 smithi106 bash[13484]: cluster 2021-01-27T16:37:37.339076+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:38.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:37 smithi094 bash[9811]: cluster 2021-01-27T16:37:37.339076+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:39.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[9795]: audit 2021-01-27T16:37:38.835000+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.94:0/2383378524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[9795]: audit 2021-01-27T16:37:38.837488+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[9795]: audit 2021-01-27T16:37:38.846557+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]': finished 2021-01-27T16:37:39.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[9795]: cluster 2021-01-27T16:37:38.846813+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T16:37:39.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[9795]: audit 2021-01-27T16:37:38.847136+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:37:39.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[13484]: audit 2021-01-27T16:37:38.835000+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.94:0/2383378524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[13484]: audit 2021-01-27T16:37:38.837488+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[13484]: audit 2021-01-27T16:37:38.846557+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]': finished 2021-01-27T16:37:39.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[13484]: cluster 2021-01-27T16:37:38.846813+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T16:37:39.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:38 smithi106 bash[13484]: audit 2021-01-27T16:37:38.847136+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:37:39.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:38 smithi094 bash[9811]: audit 2021-01-27T16:37:38.835000+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.94:0/2383378524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:38 smithi094 bash[9811]: audit 2021-01-27T16:37:38.837488+0000 mon.a (mon.0) 410 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]: dispatch 2021-01-27T16:37:39.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:38 smithi094 bash[9811]: audit 2021-01-27T16:37:38.846557+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53460a4a-1c49-4f75-961a-c6e08e18fbd1"}]': finished 2021-01-27T16:37:39.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:38 smithi094 bash[9811]: cluster 2021-01-27T16:37:38.846813+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-27T16:37:39.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:38 smithi094 bash[9811]: audit 2021-01-27T16:37:38.847136+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:37:40.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:39 smithi106 bash[9795]: cluster 2021-01-27T16:37:39.339648+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:40.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:39 smithi106 bash[9795]: audit 2021-01-27T16:37:39.474224+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.94:0/4068323536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:40.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:39 smithi106 bash[13484]: cluster 2021-01-27T16:37:39.339648+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:40.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:39 smithi106 bash[13484]: audit 2021-01-27T16:37:39.474224+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.94:0/4068323536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:40.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:39 smithi094 bash[9811]: cluster 2021-01-27T16:37:39.339648+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:40.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:39 smithi094 bash[9811]: audit 2021-01-27T16:37:39.474224+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.94:0/4068323536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:37:42.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:42 smithi106 bash[9795]: cluster 2021-01-27T16:37:41.340233+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:42.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:42 smithi106 bash[13484]: cluster 2021-01-27T16:37:41.340233+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:42 smithi094 bash[9811]: cluster 2021-01-27T16:37:41.340233+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:43.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:43 smithi094 bash[9811]: audit 2021-01-27T16:37:42.780821+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:43.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:43 smithi106 bash[9795]: audit 2021-01-27T16:37:42.780821+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:43.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:43 smithi106 bash[13484]: audit 2021-01-27T16:37:42.780821+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:44.673 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:44 smithi094 bash[9811]: cluster 2021-01-27T16:37:43.340815+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:44.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:44 smithi106 bash[9795]: cluster 2021-01-27T16:37:43.340815+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:44.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:44 smithi106 bash[13484]: cluster 2021-01-27T16:37:43.340815+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:46.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:46 smithi106 bash[9795]: cluster 2021-01-27T16:37:45.341375+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:46.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:46 smithi106 bash[13484]: cluster 2021-01-27T16:37:45.341375+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:46.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:46 smithi094 bash[9811]: cluster 2021-01-27T16:37:45.341375+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:48.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[9795]: cluster 2021-01-27T16:37:47.341935+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:48.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[9795]: audit 2021-01-27T16:37:47.714601+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T16:37:48.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[9795]: audit 2021-01-27T16:37:47.716442+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:48.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[9795]: audit 2021-01-27T16:37:47.718763+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T16:37:48.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[13484]: cluster 2021-01-27T16:37:47.341935+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:48.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[13484]: audit 2021-01-27T16:37:47.714601+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T16:37:48.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[13484]: audit 2021-01-27T16:37:47.716442+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:48.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:47 smithi106 bash[13484]: audit 2021-01-27T16:37:47.718763+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T16:37:48.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:47 smithi094 bash[9811]: cluster 2021-01-27T16:37:47.341935+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:48.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:47 smithi094 bash[9811]: audit 2021-01-27T16:37:47.714601+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-27T16:37:48.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:47 smithi094 bash[9811]: audit 2021-01-27T16:37:47.716442+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:37:48.283 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:47 smithi094 bash[9811]: audit 2021-01-27T16:37:47.718763+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-27T16:37:49.187 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:48 smithi094 bash[9811]: cephadm 2021-01-27T16:37:47.717861+0000 mgr.y (mgr.14138) 188 : cephadm [INF] Deploying daemon osd.5 on smithi094 2021-01-27T16:37:49.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:48 smithi106 bash[9795]: cephadm 2021-01-27T16:37:47.717861+0000 mgr.y (mgr.14138) 188 : cephadm [INF] Deploying daemon osd.5 on smithi094 2021-01-27T16:37:49.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:48 smithi106 bash[13484]: cephadm 2021-01-27T16:37:47.717861+0000 mgr.y (mgr.14138) 188 : cephadm [INF] Deploying daemon osd.5 on smithi094 2021-01-27T16:37:50.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:49 smithi106 bash[9795]: cluster 2021-01-27T16:37:49.342460+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:50.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:49 smithi106 bash[13484]: cluster 2021-01-27T16:37:49.342460+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:50.238 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:49 smithi094 bash[9811]: cluster 2021-01-27T16:37:49.342460+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:50.634 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 5 on host 'smithi094' 2021-01-27T16:37:51.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:50 smithi106 bash[9795]: audit 2021-01-27T16:37:50.633833+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:51.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:50 smithi106 bash[9795]: audit 2021-01-27T16:37:50.638785+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:51.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:50 smithi106 bash[13484]: audit 2021-01-27T16:37:50.633833+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:51.197 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:50 smithi106 bash[13484]: audit 2021-01-27T16:37:50.638785+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:51.212 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:50 smithi094 bash[9811]: audit 2021-01-27T16:37:50.633833+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:37:51.212 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:50 smithi094 bash[9811]: audit 2021-01-27T16:37:50.638785+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:52.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:51 smithi094 bash[9811]: cluster 2021-01-27T16:37:51.343021+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:52.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:51 smithi094 bash[9811]: audit 2021-01-27T16:37:51.640021+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:52.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:51 smithi094 bash[9811]: audit 2021-01-27T16:37:51.642309+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:52.446 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[9795]: cluster 2021-01-27T16:37:51.343021+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:52.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[9795]: audit 2021-01-27T16:37:51.640021+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:52.447 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[9795]: audit 2021-01-27T16:37:51.642309+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:52.447 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[13484]: cluster 2021-01-27T16:37:51.343021+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:52.447 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[13484]: audit 2021-01-27T16:37:51.640021+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:52.448 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:51 smithi106 bash[13484]: audit 2021-01-27T16:37:51.642309+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:37:52.665 DEBUG:teuthology.orchestra.run.smithi094:osd.5> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.5.service 2021-01-27T16:37:52.670 INFO:tasks.cephadm:Deploying osd.6 on smithi094 with /dev/vg_nvme/lv_2... 2021-01-27T16:37:52.670 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-27T16:37:52.848 INFO:journalctl@ceph.osd.5.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:37:54.282 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T16:37:54.282 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-01-27T16:37:54.283 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-01-27T16:37:54.283 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-01-27T16:37:54.283 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-27T16:37:54.283 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-27T16:37:54.284 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[14774]: --> ceph-volume lvm activate successful for osd ID: 5 2021-01-27T16:37:54.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:54 smithi106 bash[9795]: cluster 2021-01-27T16:37:53.343636+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:54.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:54 smithi106 bash[13484]: cluster 2021-01-27T16:37:53.343636+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:54.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:54 smithi094 bash[9811]: cluster 2021-01-27T16:37:53.343636+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:56.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:56 smithi106 bash[9795]: cluster 2021-01-27T16:37:55.344271+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:56.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:56 smithi106 bash[9795]: audit 2021-01-27T16:37:55.472455+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:56.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:56 smithi106 bash[13484]: cluster 2021-01-27T16:37:55.344271+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:56.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:56 smithi106 bash[13484]: audit 2021-01-27T16:37:55.472455+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:56.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:56 smithi094 bash[9811]: cluster 2021-01-27T16:37:55.344271+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:56.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:56 smithi094 bash[9811]: audit 2021-01-27T16:37:55.472455+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:37:58.196 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:37:57 smithi106 bash[9795]: cluster 2021-01-27T16:37:57.344825+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:58.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:37:57 smithi106 bash[13484]: cluster 2021-01-27T16:37:57.344825+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:37:58.281 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:37:57 smithi094 bash[9811]: cluster 2021-01-27T16:37:57.344825+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:00.147 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.855+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 msgr2=0x55f4ae03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:38:00.148 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.855+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 msgr2=0x55f4ae03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:38:00.148 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.855+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_read_frame_preamble_main r=0 2021-01-27T16:38:00.149 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.855+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_MESSAGE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).throttle_message 2021-01-27T16:38:00.150 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_BYTES pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).throttle_bytes 2021-01-27T16:38:00.150 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).throttle_dispatch_queue 2021-01-27T16:38:00.150 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).read_frame_segment seg_idx=0 2021-01-27T16:38:00.151 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).read_frame_segment seg_idx=1 2021-01-27T16:38:00.151 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 msgr2=0x55f4ae03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:38:00.151 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_read_frame_segment r=0 2021-01-27T16:38:00.151 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 msgr2=0x55f4ae03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:38:00.151 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_read_frame_epilogue_main r=0 2021-01-27T16:38:00.152 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 10 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_read_frame_dispatch tag=17 2021-01-27T16:38:00.152 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_message 2021-01-27T16:38:00.152 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 5 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T16:38:00.152 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 5 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).handle_message received message m=0x55f4ae0504e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:38:00.153 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 queue 0x55f4ae0504e0 prio 196 2021-01-27T16:38:00.153 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 --2- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 0x55f4ae03c300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x55f4ae04be60 tx=0x55f4ae080240).read_frame 2021-01-27T16:38:00.153 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fdf969700 20 -- 172.21.15.94:0/4245282118 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f4ae0cf400 msgr2=0x55f4ae03c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:38:00.153 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fde166700 1 -- 172.21.15.94:0/4245282118 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f4ae0504e0 con 0x55f4ae0cf400 2021-01-27T16:38:00.153 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fde166700 10 -- 172.21.15.94:0/4245282118 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:38:00.154 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:37:59 smithi094 bash[15110]: debug 2021-01-27T16:37:59.859+0000 7f1fde166700 20 -- 172.21.15.94:0/4245282118 done calling dispatch on 0x55f4ae0504e0 2021-01-27T16:38:00.154 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:38:00 smithi094 bash[15110]: debug 2021-01-27T16:38:00.147+0000 7f1fe5bf1200 -1 Falling back to public interface 2021-01-27T16:38:00.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:00 smithi106 bash[9795]: cluster 2021-01-27T16:37:59.345485+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:00.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:00 smithi106 bash[13484]: cluster 2021-01-27T16:37:59.345485+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:00.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:00 smithi094 bash[9811]: cluster 2021-01-27T16:37:59.345485+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:01.072 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-27T16:38:01.073 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-27T16:38:01.073 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2021-01-27T16:38:01.073 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2021-01-27T16:38:01.073 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0179001 s, 586 MB/s 2021-01-27T16:38:01.073 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2021-01-27T16:38:02.101 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi094:vg_nvme/lv_2 2021-01-27T16:38:02.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:02 smithi106 bash[9795]: cluster 2021-01-27T16:38:01.346100+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:02.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:02 smithi106 bash[13484]: cluster 2021-01-27T16:38:01.346100+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:02.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:02 smithi094 bash[9811]: cluster 2021-01-27T16:38:01.346100+0000 mgr.y (mgr.14138) 195 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:03.411 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:38:03 smithi094 bash[15110]: debug 2021-01-27T16:38:03.131+0000 7f1fe5bf1200 -1 osd.5 0 log_to_monitors {default=true} 2021-01-27T16:38:03.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[9795]: audit 2021-01-27T16:38:03.138974+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:03.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[9795]: audit 2021-01-27T16:38:03.143205+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:03.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[9795]: audit 2021-01-27T16:38:03.145705+0000 mon.a (mon.0) 424 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:03.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[13484]: audit 2021-01-27T16:38:03.138974+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:03.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[13484]: audit 2021-01-27T16:38:03.143205+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:03.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:03 smithi106 bash[13484]: audit 2021-01-27T16:38:03.145705+0000 mon.a (mon.0) 424 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:03.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:03 smithi094 bash[9811]: audit 2021-01-27T16:38:03.138974+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:03.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:03 smithi094 bash[9811]: audit 2021-01-27T16:38:03.143205+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:03.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:03 smithi094 bash[9811]: audit 2021-01-27T16:38:03.145705+0000 mon.a (mon.0) 424 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-27T16:38:04.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: cluster 2021-01-27T16:38:03.346673+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:04.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.422639+0000 mon.b (mon.2) 7 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.422945+0000 mon.a (mon.0) 425 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T16:38:04.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: cluster 2021-01-27T16:38:03.423165+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T16:38:04.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.423658+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:04.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.424988+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.513058+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.939386+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[9795]: audit 2021-01-27T16:38:03.949353+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: cluster 2021-01-27T16:38:03.346673+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:04.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.422639+0000 mon.b (mon.2) 7 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.422945+0000 mon.a (mon.0) 425 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T16:38:04.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: cluster 2021-01-27T16:38:03.423165+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T16:38:04.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.423658+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:04.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.424988+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.513058+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.939386+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:04 smithi106 bash[13484]: audit 2021-01-27T16:38:03.949353+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.781 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[15110]: debug 2021-01-27T16:38:04.431+0000 7f1fdd965700 -1 osd.5 0 waiting for initial osdmap 2021-01-27T16:38:04.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: cluster 2021-01-27T16:38:03.346673+0000 mgr.y (mgr.14138) 196 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:04.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.422639+0000 mon.b (mon.2) 7 : audit [INF] from='osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.422945+0000 mon.a (mon.0) 425 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-27T16:38:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: cluster 2021-01-27T16:38:03.423165+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-27T16:38:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.423658+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.424988+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.513058+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.939386+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:04.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:04 smithi094 bash[9811]: audit 2021-01-27T16:38:03.949353+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:05.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: cephadm 2021-01-27T16:38:03.514130+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:38:05.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: cephadm 2021-01-27T16:38:03.941438+0000 mgr.y (mgr.14138) 198 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: cephadm 2021-01-27T16:38:03.950794+0000 mgr.y (mgr.14138) 199 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: audit 2021-01-27T16:38:04.425485+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:05.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: cluster 2021-01-27T16:38:04.425733+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T16:38:05.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: audit 2021-01-27T16:38:04.427086+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:05.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[9795]: audit 2021-01-27T16:38:04.436505+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:05.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: cephadm 2021-01-27T16:38:03.514130+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:38:05.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: cephadm 2021-01-27T16:38:03.941438+0000 mgr.y (mgr.14138) 198 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: cephadm 2021-01-27T16:38:03.950794+0000 mgr.y (mgr.14138) 199 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: audit 2021-01-27T16:38:04.425485+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: cluster 2021-01-27T16:38:04.425733+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T16:38:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: audit 2021-01-27T16:38:04.427086+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:05.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:05 smithi106 bash[13484]: audit 2021-01-27T16:38:04.436505+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:05.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: cephadm 2021-01-27T16:38:03.514130+0000 mgr.y (mgr.14138) 197 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:38:05.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: cephadm 2021-01-27T16:38:03.941438+0000 mgr.y (mgr.14138) 198 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: cephadm 2021-01-27T16:38:03.950794+0000 mgr.y (mgr.14138) 199 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:05.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: audit 2021-01-27T16:38:04.425485+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:05.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: cluster 2021-01-27T16:38:04.425733+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-27T16:38:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: audit 2021-01-27T16:38:04.427086+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:05.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:05 smithi094 bash[9811]: audit 2021-01-27T16:38:04.436505+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:06.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: cluster 2021-01-27T16:38:04.188010+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:06.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: cluster 2021-01-27T16:38:04.188210+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:06.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: cluster 2021-01-27T16:38:05.347254+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:06.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: cluster 2021-01-27T16:38:05.427982+0000 mon.a (mon.0) 436 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:38:06.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: cluster 2021-01-27T16:38:05.428192+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T16:38:06.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: audit 2021-01-27T16:38:05.428511+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:06.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: audit 2021-01-27T16:38:05.951185+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: audit 2021-01-27T16:38:05.954776+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: audit 2021-01-27T16:38:05.956637+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:06.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[9795]: audit 2021-01-27T16:38:05.959059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:06.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: cluster 2021-01-27T16:38:04.188010+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:06.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: cluster 2021-01-27T16:38:04.188210+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: cluster 2021-01-27T16:38:05.347254+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: cluster 2021-01-27T16:38:05.427982+0000 mon.a (mon.0) 436 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:38:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: cluster 2021-01-27T16:38:05.428192+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T16:38:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: audit 2021-01-27T16:38:05.428511+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:06.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: audit 2021-01-27T16:38:05.951185+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: audit 2021-01-27T16:38:05.954776+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: audit 2021-01-27T16:38:05.956637+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:06.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:06 smithi106 bash[13484]: audit 2021-01-27T16:38:05.959059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:06.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: cluster 2021-01-27T16:38:04.188010+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:06.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: cluster 2021-01-27T16:38:04.188210+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:06.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: cluster 2021-01-27T16:38:05.347254+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-27T16:38:06.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: cluster 2021-01-27T16:38:05.427982+0000 mon.a (mon.0) 436 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:38:06.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: cluster 2021-01-27T16:38:05.428192+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-27T16:38:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: audit 2021-01-27T16:38:05.428511+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:38:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: audit 2021-01-27T16:38:05.951185+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: audit 2021-01-27T16:38:05.954776+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:06.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: audit 2021-01-27T16:38:05.956637+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:06.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:06 smithi094 bash[9811]: audit 2021-01-27T16:38:05.959059+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:07.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[9795]: audit 2021-01-27T16:38:05.949039+0000 mgr.y (mgr.14138) 201 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:07.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[9795]: cephadm 2021-01-27T16:38:05.954192+0000 mgr.y (mgr.14138) 202 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:07.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[9795]: cluster 2021-01-27T16:38:06.448522+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T16:38:07.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[13484]: audit 2021-01-27T16:38:05.949039+0000 mgr.y (mgr.14138) 201 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:07.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[13484]: cephadm 2021-01-27T16:38:05.954192+0000 mgr.y (mgr.14138) 202 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:07.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:07 smithi106 bash[13484]: cluster 2021-01-27T16:38:06.448522+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T16:38:07.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:07 smithi094 bash[9811]: audit 2021-01-27T16:38:05.949039+0000 mgr.y (mgr.14138) 201 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:07.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:07 smithi094 bash[9811]: cephadm 2021-01-27T16:38:05.954192+0000 mgr.y (mgr.14138) 202 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:07.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:07 smithi094 bash[9811]: cluster 2021-01-27T16:38:06.448522+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-27T16:38:08.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:08 smithi106 bash[9795]: cluster 2021-01-27T16:38:07.347836+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:08.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:08 smithi106 bash[13484]: cluster 2021-01-27T16:38:07.347836+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:08.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:08 smithi094 bash[9811]: cluster 2021-01-27T16:38:07.347836+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:09.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:09 smithi094 bash[9811]: cluster 2021-01-27T16:38:09.348524+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:09.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:09 smithi106 bash[9795]: cluster 2021-01-27T16:38:09.348524+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:09.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:09 smithi106 bash[13484]: cluster 2021-01-27T16:38:09.348524+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:10.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:10 smithi094 bash[9811]: audit 2021-01-27T16:38:10.425798+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.94:0/4245958490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:10 smithi094 bash[9811]: audit 2021-01-27T16:38:10.428338+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:10 smithi094 bash[9811]: audit 2021-01-27T16:38:10.436819+0000 mon.a (mon.0) 445 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]': finished 2021-01-27T16:38:10.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:10 smithi094 bash[9811]: cluster 2021-01-27T16:38:10.436988+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T16:38:10.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:10 smithi094 bash[9811]: audit 2021-01-27T16:38:10.437250+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:10.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[9795]: audit 2021-01-27T16:38:10.425798+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.94:0/4245958490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[9795]: audit 2021-01-27T16:38:10.428338+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[9795]: audit 2021-01-27T16:38:10.436819+0000 mon.a (mon.0) 445 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]': finished 2021-01-27T16:38:10.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[9795]: cluster 2021-01-27T16:38:10.436988+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T16:38:10.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[9795]: audit 2021-01-27T16:38:10.437250+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:10.947 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[13484]: audit 2021-01-27T16:38:10.425798+0000 mon.b (mon.2) 8 : audit [INF] from='client.? 172.21.15.94:0/4245958490' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[13484]: audit 2021-01-27T16:38:10.428338+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]: dispatch 2021-01-27T16:38:10.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[13484]: audit 2021-01-27T16:38:10.436819+0000 mon.a (mon.0) 445 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0133a60f-9d9e-4173-a081-8967e48630ec"}]': finished 2021-01-27T16:38:10.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[13484]: cluster 2021-01-27T16:38:10.436988+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-27T16:38:10.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:10 smithi106 bash[13484]: audit 2021-01-27T16:38:10.437250+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:11.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:11 smithi094 bash[9811]: audit 2021-01-27T16:38:11.081093+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.94:0/1374379261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:11.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:11 smithi094 bash[9811]: cluster 2021-01-27T16:38:11.349117+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:11.945 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:11 smithi106 bash[9795]: audit 2021-01-27T16:38:11.081093+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.94:0/1374379261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:11.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:11 smithi106 bash[9795]: cluster 2021-01-27T16:38:11.349117+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:11.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:11 smithi106 bash[13484]: audit 2021-01-27T16:38:11.081093+0000 mon.b (mon.2) 9 : audit [DBG] from='client.? 172.21.15.94:0/1374379261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:11.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:11 smithi106 bash[13484]: cluster 2021-01-27T16:38:11.349117+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:14.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:14 smithi106 bash[13484]: cluster 2021-01-27T16:38:13.349683+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:14.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:14 smithi106 bash[13484]: audit 2021-01-27T16:38:14.350357+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:14.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:14 smithi106 bash[9795]: cluster 2021-01-27T16:38:13.349683+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:14.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:14 smithi106 bash[9795]: audit 2021-01-27T16:38:14.350357+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:14.718 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:14 smithi094 bash[9811]: cluster 2021-01-27T16:38:13.349683+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:14.718 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:14 smithi094 bash[9811]: audit 2021-01-27T16:38:14.350357+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:16.694 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:16 smithi094 bash[9811]: cluster 2021-01-27T16:38:15.350247+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:16.695 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:16 smithi106 bash[13484]: cluster 2021-01-27T16:38:15.350247+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:16.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:16 smithi106 bash[9795]: cluster 2021-01-27T16:38:15.350247+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:18.195 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:17 smithi106 bash[9795]: cluster 2021-01-27T16:38:17.350809+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:18.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:17 smithi106 bash[13484]: cluster 2021-01-27T16:38:17.350809+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:18.281 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:17 smithi094 bash[9811]: cluster 2021-01-27T16:38:17.350809+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:19.531 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:19 smithi094 bash[9811]: audit 2021-01-27T16:38:19.205085+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T16:38:19.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:19 smithi094 bash[9811]: audit 2021-01-27T16:38:19.206890+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:19.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:19 smithi094 bash[9811]: audit 2021-01-27T16:38:19.209246+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T16:38:19.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[9795]: audit 2021-01-27T16:38:19.205085+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T16:38:19.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[9795]: audit 2021-01-27T16:38:19.206890+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:19.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[9795]: audit 2021-01-27T16:38:19.209246+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T16:38:19.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[13484]: audit 2021-01-27T16:38:19.205085+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-27T16:38:19.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[13484]: audit 2021-01-27T16:38:19.206890+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:19.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:19 smithi106 bash[13484]: audit 2021-01-27T16:38:19.209246+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-27T16:38:20.531 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:20 smithi094 bash[9811]: cephadm 2021-01-27T16:38:19.208296+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Deploying daemon osd.6 on smithi094 2021-01-27T16:38:20.532 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:20 smithi094 bash[9811]: cluster 2021-01-27T16:38:19.351427+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:20.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:20 smithi106 bash[9795]: cephadm 2021-01-27T16:38:19.208296+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Deploying daemon osd.6 on smithi094 2021-01-27T16:38:20.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:20 smithi106 bash[9795]: cluster 2021-01-27T16:38:19.351427+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:20.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:20 smithi106 bash[13484]: cephadm 2021-01-27T16:38:19.208296+0000 mgr.y (mgr.14138) 209 : cephadm [INF] Deploying daemon osd.6 on smithi094 2021-01-27T16:38:20.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:20 smithi106 bash[13484]: cluster 2021-01-27T16:38:19.351427+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 6 on host 'smithi094' 2021-01-27T16:38:22.460 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:22 smithi094 bash[9811]: cluster 2021-01-27T16:38:21.352030+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:22.460 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:22 smithi094 bash[9811]: audit 2021-01-27T16:38:22.118596+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:22.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[9795]: cluster 2021-01-27T16:38:21.352030+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:22.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[9795]: audit 2021-01-27T16:38:22.118596+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:22.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[9795]: audit 2021-01-27T16:38:22.124019+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:22.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[13484]: cluster 2021-01-27T16:38:21.352030+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:22.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[13484]: audit 2021-01-27T16:38:22.118596+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:22.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:22 smithi106 bash[13484]: audit 2021-01-27T16:38:22.124019+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:22.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:22 smithi094 bash[9811]: audit 2021-01-27T16:38:22.124019+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:23.655 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:23 smithi094 bash[9811]: cephadm 2021-01-27T16:38:22.117358+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:38:23.656 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:23 smithi094 bash[9811]: audit 2021-01-27T16:38:23.271216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:23.656 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:23 smithi094 bash[9811]: audit 2021-01-27T16:38:23.273543+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:23.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[9795]: cephadm 2021-01-27T16:38:22.117358+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:38:23.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[9795]: audit 2021-01-27T16:38:23.271216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:23.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[9795]: audit 2021-01-27T16:38:23.273543+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:23.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[13484]: cephadm 2021-01-27T16:38:22.117358+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:38:23.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[13484]: audit 2021-01-27T16:38:23.271216+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:23.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:23 smithi106 bash[13484]: audit 2021-01-27T16:38:23.273543+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:23.732 DEBUG:teuthology.orchestra.run.smithi094:osd.6> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.6.service 2021-01-27T16:38:23.734 INFO:tasks.cephadm:Deploying osd.7 on smithi094 with /dev/vg_nvme/lv_1... 2021-01-27T16:38:23.734 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-27T16:38:23.775 INFO:journalctl@ceph.osd.6.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:38:24.690 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:24 smithi094 bash[9811]: cluster 2021-01-27T16:38:23.352583+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:24.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:24 smithi106 bash[9795]: cluster 2021-01-27T16:38:23.352583+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:24.695 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:24 smithi106 bash[13484]: cluster 2021-01-27T16:38:23.352583+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:25.531 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T16:38:25.532 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-01-27T16:38:25.532 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-01-27T16:38:25.532 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-01-27T16:38:25.532 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-27T16:38:25.533 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-27T16:38:25.533 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:25 smithi094 bash[17238]: --> ceph-volume lvm activate successful for osd ID: 6 2021-01-27T16:38:26.684 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:26 smithi094 bash[9811]: cluster 2021-01-27T16:38:25.353113+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:26.685 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:26 smithi094 bash[9811]: audit 2021-01-27T16:38:25.476902+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:38:26.685 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:26 smithi094 bash[9811]: audit 2021-01-27T16:38:25.480208+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:26.685 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:26 smithi094 bash[9811]: audit 2021-01-27T16:38:25.480596+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:38:26.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[9795]: cluster 2021-01-27T16:38:25.353113+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:26.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[9795]: audit 2021-01-27T16:38:25.476902+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:38:26.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[9795]: audit 2021-01-27T16:38:25.480208+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:26.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[9795]: audit 2021-01-27T16:38:25.480596+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:38:26.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[13484]: cluster 2021-01-27T16:38:25.353113+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:26.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[13484]: audit 2021-01-27T16:38:25.476902+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:38:26.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[13484]: audit 2021-01-27T16:38:25.480208+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:26.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:26 smithi106 bash[13484]: audit 2021-01-27T16:38:25.480596+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:38:28.195 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:27 smithi106 bash[9795]: cluster 2021-01-27T16:38:27.353685+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:28.195 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:27 smithi106 bash[13484]: cluster 2021-01-27T16:38:27.353685+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:28.262 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:27 smithi094 bash[9811]: cluster 2021-01-27T16:38:27.353685+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:30.282 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 msgr2=0x55f7b9e09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:38:30.282 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 msgr2=0x55f7b9e09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:38:30.282 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_read_frame_preamble_main r=0 2021-01-27T16:38:30.283 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_MESSAGE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).throttle_message 2021-01-27T16:38:30.283 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_BYTES pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).throttle_bytes 2021-01-27T16:38:30.283 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).throttle_dispatch_queue 2021-01-27T16:38:30.283 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).read_frame_segment seg_idx=0 2021-01-27T16:38:30.283 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).read_frame_segment seg_idx=1 2021-01-27T16:38:30.284 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 msgr2=0x55f7b9e09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:38:30.284 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_read_frame_segment r=0 2021-01-27T16:38:30.284 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 msgr2=0x55f7b9e09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:38:30.284 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_read_frame_epilogue_main r=0 2021-01-27T16:38:30.285 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 10 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_read_frame_dispatch tag=17 2021-01-27T16:38:30.285 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_message 2021-01-27T16:38:30.285 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 5 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T16:38:30.285 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 5 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).handle_message received message m=0x55f7b9e1e4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:38:30.285 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 queue 0x55f7b9e1e4e0 prio 196 2021-01-27T16:38:30.286 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 --2- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 0x55f7b9e09e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x55f7b9e19e60 tx=0x55f7b9e4ed80).read_frame 2021-01-27T16:38:30.286 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3f87700 20 -- 172.21.15.94:0/3126087812 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f7b9e9d000 msgr2=0x55f7b9e09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:38:30.286 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3786700 1 -- 172.21.15.94:0/3126087812 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f7b9e1e4e0 con 0x55f7b9e9d000 2021-01-27T16:38:30.286 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3786700 10 -- 172.21.15.94:0/3126087812 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:38:30.286 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:29 smithi094 bash[17527]: debug 2021-01-27T16:38:29.967+0000 7f61a3786700 20 -- 172.21.15.94:0/3126087812 done calling dispatch on 0x55f7b9e1e4e0 2021-01-27T16:38:30.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:30 smithi106 bash[9795]: cluster 2021-01-27T16:38:29.354217+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:30.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:30 smithi106 bash[13484]: cluster 2021-01-27T16:38:29.354217+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:30.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:30 smithi094 bash[9811]: cluster 2021-01-27T16:38:29.354217+0000 mgr.y (mgr.14138) 216 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:30.781 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:30 smithi094 bash[17527]: debug 2021-01-27T16:38:30.507+0000 7f61ab211200 -1 Falling back to public interface 2021-01-27T16:38:32.259 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-27T16:38:32.260 INFO:teuthology.orchestra.run.smithi094.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-27T16:38:32.260 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10+0 records in 2021-01-27T16:38:32.260 INFO:teuthology.orchestra.run.smithi094.stderr:10+0 records out 2021-01-27T16:38:32.260 INFO:teuthology.orchestra.run.smithi094.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0175268 s, 598 MB/s 2021-01-27T16:38:32.261 INFO:teuthology.orchestra.run.smithi094.stderr:--> Zapping successful for: 2021-01-27T16:38:32.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:32 smithi106 bash[9795]: cluster 2021-01-27T16:38:31.354790+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:32.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:32 smithi106 bash[13484]: cluster 2021-01-27T16:38:31.354790+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:32.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:32 smithi094 bash[9811]: cluster 2021-01-27T16:38:31.354790+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:33.394 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch daemon add osd smithi094:vg_nvme/lv_1 2021-01-27T16:38:34.031 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:33 smithi094 bash[17527]: debug 2021-01-27T16:38:33.543+0000 7f61ab211200 -1 osd.6 0 log_to_monitors {default=true} 2021-01-27T16:38:34.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[9795]: cluster 2021-01-27T16:38:33.355359+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:34.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[9795]: audit 2021-01-27T16:38:33.556879+0000 mon.c (mon.1) 14 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[9795]: audit 2021-01-27T16:38:33.557709+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[9795]: audit 2021-01-27T16:38:34.276542+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:34.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[13484]: cluster 2021-01-27T16:38:33.355359+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:34.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[13484]: audit 2021-01-27T16:38:33.556879+0000 mon.c (mon.1) 14 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[13484]: audit 2021-01-27T16:38:33.557709+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:34 smithi106 bash[13484]: audit 2021-01-27T16:38:34.276542+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:34.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:34 smithi094 bash[9811]: cluster 2021-01-27T16:38:33.355359+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:34.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:34 smithi094 bash[9811]: audit 2021-01-27T16:38:33.556879+0000 mon.c (mon.1) 14 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:34 smithi094 bash[9811]: audit 2021-01-27T16:38:33.557709+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-27T16:38:34.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:34 smithi094 bash[9811]: audit 2021-01-27T16:38:34.276542+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:35.435 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.425034+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T16:38:35.435 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: cluster 2021-01-27T16:38:34.425281+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T16:38:35.435 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.426179+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:35.436 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.427008+0000 mon.c (mon.1) 15 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.432718+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.695 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.646190+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.653936+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[9795]: audit 2021-01-27T16:38:34.664752+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.425034+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T16:38:35.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: cluster 2021-01-27T16:38:34.425281+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T16:38:35.696 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.426179+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.427008+0000 mon.c (mon.1) 15 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.432718+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.646190+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.653936+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:35 smithi106 bash[13484]: audit 2021-01-27T16:38:34.664752+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.736 INFO:journalctl@ceph.osd.6.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[17527]: debug 2021-01-27T16:38:35.439+0000 7f61a1782700 -1 osd.6 0 waiting for initial osdmap 2021-01-27T16:38:35.736 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.425034+0000 mon.a (mon.0) 461 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-27T16:38:35.737 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: cluster 2021-01-27T16:38:34.425281+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-27T16:38:35.737 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.426179+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:35.737 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.427008+0000 mon.c (mon.1) 15 : audit [INF] from='osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.737 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.432718+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:38:35.737 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.646190+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.738 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.653936+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:35.738 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:35 smithi094 bash[9811]: audit 2021-01-27T16:38:34.664752+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:36.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: cephadm 2021-01-27T16:38:34.655601+0000 mgr.y (mgr.14138) 219 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: cephadm 2021-01-27T16:38:34.666081+0000 mgr.y (mgr.14138) 220 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: cluster 2021-01-27T16:38:35.356058+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:36.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: audit 2021-01-27T16:38:35.436627+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:36.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: cluster 2021-01-27T16:38:35.436888+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T16:38:36.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: audit 2021-01-27T16:38:35.437790+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:36.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[9795]: audit 2021-01-27T16:38:35.445709+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:36.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: cephadm 2021-01-27T16:38:34.655601+0000 mgr.y (mgr.14138) 219 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: cephadm 2021-01-27T16:38:34.666081+0000 mgr.y (mgr.14138) 220 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: cluster 2021-01-27T16:38:35.356058+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: audit 2021-01-27T16:38:35.436627+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: cluster 2021-01-27T16:38:35.436888+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T16:38:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: audit 2021-01-27T16:38:35.437790+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:36.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:36 smithi106 bash[13484]: audit 2021-01-27T16:38:35.445709+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:36.776 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: cephadm 2021-01-27T16:38:34.655601+0000 mgr.y (mgr.14138) 219 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.776 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: cephadm 2021-01-27T16:38:34.666081+0000 mgr.y (mgr.14138) 220 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:38:36.776 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: cluster 2021-01-27T16:38:35.356058+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:36.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: audit 2021-01-27T16:38:35.436627+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:38:36.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: cluster 2021-01-27T16:38:35.436888+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-27T16:38:36.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: audit 2021-01-27T16:38:35.437790+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:36.777 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:36 smithi094 bash[9811]: audit 2021-01-27T16:38:35.445709+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:37.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cluster 2021-01-27T16:38:34.521202+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:37.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cluster 2021-01-27T16:38:34.521320+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:37.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cluster 2021-01-27T16:38:36.448162+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091] boot 2021-01-27T16:38:37.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cluster 2021-01-27T16:38:36.448270+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T16:38:37.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:36.449040+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:37.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:37.206874+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:37.209095+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cephadm 2021-01-27T16:38:37.211856+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:37.212377+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:37.213986+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:37.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: audit 2021-01-27T16:38:37.216009+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:37.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:37 smithi094 bash[9811]: cluster 2021-01-27T16:38:37.356632+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:37.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cluster 2021-01-27T16:38:34.521202+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:37.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cluster 2021-01-27T16:38:34.521320+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:37.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cluster 2021-01-27T16:38:36.448162+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091] boot 2021-01-27T16:38:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cluster 2021-01-27T16:38:36.448270+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T16:38:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:36.449040+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:37.206874+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:37.209095+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:37.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cephadm 2021-01-27T16:38:37.211856+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:37.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:37.212377+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:37.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:37.213986+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:37.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: audit 2021-01-27T16:38:37.216009+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:37.948 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[9795]: cluster 2021-01-27T16:38:37.356632+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:37.948 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cluster 2021-01-27T16:38:34.521202+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:38:37.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cluster 2021-01-27T16:38:34.521320+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:38:37.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cluster 2021-01-27T16:38:36.448162+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.94:6816/1928175091,v1:172.21.15.94:6817/1928175091] boot 2021-01-27T16:38:37.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cluster 2021-01-27T16:38:36.448270+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-27T16:38:37.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:36.449040+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-27T16:38:37.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:37.206874+0000 mgr.y (mgr.14138) 222 : audit [DBG] from='client.34283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi094:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:38:37.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:37.209095+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-27T16:38:37.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cephadm 2021-01-27T16:38:37.211856+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Applying drive group None on host smithi094... 2021-01-27T16:38:37.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:37.212377+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-27T16:38:37.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:37.213986+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:37.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: audit 2021-01-27T16:38:37.216009+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:37.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:37 smithi106 bash[13484]: cluster 2021-01-27T16:38:37.356632+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-01-27T16:38:38.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:38 smithi094 bash[9811]: cluster 2021-01-27T16:38:37.457606+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T16:38:38.945 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:38 smithi106 bash[13484]: cluster 2021-01-27T16:38:37.457606+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T16:38:38.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:38 smithi106 bash[9795]: cluster 2021-01-27T16:38:37.457606+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-27T16:38:39.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:39 smithi094 bash[9811]: cluster 2021-01-27T16:38:39.357259+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:39.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:39 smithi106 bash[9795]: cluster 2021-01-27T16:38:39.357259+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:39.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:39 smithi106 bash[13484]: cluster 2021-01-27T16:38:39.357259+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:42.696 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: cluster 2021-01-27T16:38:41.357867+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:42.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: audit 2021-01-27T16:38:41.713614+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.94:0/3165945628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: audit 2021-01-27T16:38:41.715101+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: audit 2021-01-27T16:38:41.723872+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]': finished 2021-01-27T16:38:42.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: cluster 2021-01-27T16:38:41.724060+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T16:38:42.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: audit 2021-01-27T16:38:41.724333+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:38:42.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[9795]: audit 2021-01-27T16:38:42.356599+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.94:0/205471660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:42.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: cluster 2021-01-27T16:38:41.357867+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:42.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: audit 2021-01-27T16:38:41.713614+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.94:0/3165945628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: audit 2021-01-27T16:38:41.715101+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: audit 2021-01-27T16:38:41.723872+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]': finished 2021-01-27T16:38:42.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: cluster 2021-01-27T16:38:41.724060+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T16:38:42.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: audit 2021-01-27T16:38:41.724333+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:38:42.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:42 smithi106 bash[13484]: audit 2021-01-27T16:38:42.356599+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.94:0/205471660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:42.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: cluster 2021-01-27T16:38:41.357867+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:42.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: audit 2021-01-27T16:38:41.713614+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.94:0/3165945628' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: audit 2021-01-27T16:38:41.715101+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]: dispatch 2021-01-27T16:38:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: audit 2021-01-27T16:38:41.723872+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ee57c5f-098b-4032-8cd6-265cd1c5c34e"}]': finished 2021-01-27T16:38:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: cluster 2021-01-27T16:38:41.724060+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-27T16:38:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: audit 2021-01-27T16:38:41.724333+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:38:42.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:42 smithi094 bash[9811]: audit 2021-01-27T16:38:42.356599+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.94:0/205471660' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-27T16:38:44.697 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:44 smithi106 bash[9795]: cluster 2021-01-27T16:38:43.358394+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:44.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:44 smithi106 bash[13484]: cluster 2021-01-27T16:38:43.358394+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:44.780 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:44 smithi094 bash[9811]: cluster 2021-01-27T16:38:43.358394+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:46.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:46 smithi106 bash[13484]: cluster 2021-01-27T16:38:45.358955+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:46.697 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:46 smithi106 bash[13484]: audit 2021-01-27T16:38:45.600668+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:46.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:46 smithi106 bash[9795]: cluster 2021-01-27T16:38:45.358955+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:46.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:46 smithi106 bash[9795]: audit 2021-01-27T16:38:45.600668+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:46.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:46 smithi094 bash[9811]: cluster 2021-01-27T16:38:45.358955+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:46.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:46 smithi094 bash[9811]: audit 2021-01-27T16:38:45.600668+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:48.197 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:47 smithi106 bash[9795]: cluster 2021-01-27T16:38:47.359533+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:48.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:47 smithi106 bash[13484]: cluster 2021-01-27T16:38:47.359533+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:48.281 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:47 smithi094 bash[9811]: cluster 2021-01-27T16:38:47.359533+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:50.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:50 smithi106 bash[9795]: cluster 2021-01-27T16:38:49.360104+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:50.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:50 smithi106 bash[13484]: cluster 2021-01-27T16:38:49.360104+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:50.780 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:50 smithi094 bash[9811]: cluster 2021-01-27T16:38:49.360104+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[9795]: audit 2021-01-27T16:38:50.628563+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T16:38:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[9795]: audit 2021-01-27T16:38:50.630721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:51.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[9795]: audit 2021-01-27T16:38:50.633126+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T16:38:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[13484]: audit 2021-01-27T16:38:50.628563+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T16:38:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[13484]: audit 2021-01-27T16:38:50.630721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:51.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:51 smithi106 bash[13484]: audit 2021-01-27T16:38:50.633126+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T16:38:51.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:51 smithi094 bash[9811]: audit 2021-01-27T16:38:50.628563+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-27T16:38:51.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:51 smithi094 bash[9811]: audit 2021-01-27T16:38:50.630721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:38:51.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:51 smithi094 bash[9811]: audit 2021-01-27T16:38:50.633126+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-27T16:38:52.530 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:52 smithi094 bash[9811]: cephadm 2021-01-27T16:38:50.632306+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Deploying daemon osd.7 on smithi094 2021-01-27T16:38:52.531 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:52 smithi094 bash[9811]: cluster 2021-01-27T16:38:51.360668+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:52.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:52 smithi106 bash[9795]: cephadm 2021-01-27T16:38:50.632306+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Deploying daemon osd.7 on smithi094 2021-01-27T16:38:52.698 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:52 smithi106 bash[9795]: cluster 2021-01-27T16:38:51.360668+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:52.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:52 smithi106 bash[13484]: cephadm 2021-01-27T16:38:50.632306+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Deploying daemon osd.7 on smithi094 2021-01-27T16:38:52.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:52 smithi106 bash[13484]: cluster 2021-01-27T16:38:51.360668+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:53.706 INFO:teuthology.orchestra.run.smithi094.stdout:Created osd(s) 7 on host 'smithi094' 2021-01-27T16:38:54.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[13484]: cluster 2021-01-27T16:38:53.361221+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:54.698 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[13484]: audit 2021-01-27T16:38:53.701345+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:54.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[13484]: audit 2021-01-27T16:38:53.708036+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:54.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[9795]: cluster 2021-01-27T16:38:53.361221+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:54.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[9795]: audit 2021-01-27T16:38:53.701345+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:54.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:54 smithi106 bash[9795]: audit 2021-01-27T16:38:53.708036+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:54.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:54 smithi094 bash[9811]: cluster 2021-01-27T16:38:53.361221+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:54.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:54 smithi094 bash[9811]: audit 2021-01-27T16:38:53.701345+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:38:54.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:54 smithi094 bash[9811]: audit 2021-01-27T16:38:53.708036+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:55.345 DEBUG:teuthology.orchestra.run.smithi094:osd.7> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@osd.7.service 2021-01-27T16:38:55.348 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi106 2021-01-27T16:38:55.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2021-01-27T16:38:55.424 INFO:journalctl@ceph.osd.7.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:38:56.198 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[13484]: audit 2021-01-27T16:38:54.913604+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:56.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[13484]: audit 2021-01-27T16:38:54.915458+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:56.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[13484]: cluster 2021-01-27T16:38:55.361803+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:56.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[13484]: audit 2021-01-27T16:38:55.488688+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:56.199 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[9795]: audit 2021-01-27T16:38:54.913604+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:56.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[9795]: audit 2021-01-27T16:38:54.915458+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:56.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[9795]: cluster 2021-01-27T16:38:55.361803+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:56.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:55 smithi106 bash[9795]: audit 2021-01-27T16:38:55.488688+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:56.281 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:55 smithi094 bash[9811]: audit 2021-01-27T16:38:54.913604+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:56.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:55 smithi094 bash[9811]: audit 2021-01-27T16:38:54.915458+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-27T16:38:56.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:55 smithi094 bash[9811]: cluster 2021-01-27T16:38:55.361803+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:56.282 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:55 smithi094 bash[9811]: audit 2021-01-27T16:38:55.488688+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:38:57.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T16:38:57.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-01-27T16:38:57.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-01-27T16:38:57.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-01-27T16:38:57.283 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-27T16:38:57.283 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-27T16:38:57.283 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:38:56 smithi094 bash[19736]: --> ceph-volume lvm activate successful for osd ID: 7 2021-01-27T16:38:58.127 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:38:57 smithi094 bash[9811]: cluster 2021-01-27T16:38:57.362363+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:58.198 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:38:57 smithi106 bash[9795]: cluster 2021-01-27T16:38:57.362363+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:38:58.199 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:38:57 smithi106 bash[13484]: cluster 2021-01-27T16:38:57.362363+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:00.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:00 smithi106 bash[9795]: cluster 2021-01-27T16:38:59.362977+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:00.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:00 smithi106 bash[13484]: cluster 2021-01-27T16:38:59.362977+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:00.712 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:00 smithi094 bash[9811]: cluster 2021-01-27T16:38:59.362977+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:01.783 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 msgr2=0x560c8ddd7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-27T16:39:01.783 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 msgr2=0x560c8ddd7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-27T16:39:01.783 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_read_frame_preamble_main r=0 2021-01-27T16:39:01.783 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_MESSAGE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).throttle_message 2021-01-27T16:39:01.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_BYTES pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).throttle_bytes 2021-01-27T16:39:01.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).throttle_dispatch_queue 2021-01-27T16:39:01.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).read_frame_segment seg_idx=0 2021-01-27T16:39:01.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).read_frame_segment seg_idx=1 2021-01-27T16:39:01.784 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 msgr2=0x560c8ddd7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-27T16:39:01.785 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_read_frame_segment r=0 2021-01-27T16:39:01.785 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 msgr2=0x560c8ddd7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-27T16:39:01.785 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_read_frame_epilogue_main r=0 2021-01-27T16:39:01.785 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 10 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_read_frame_dispatch tag=17 2021-01-27T16:39:01.786 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_message 2021-01-27T16:39:01.786 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 5 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-27T16:39:01.786 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 5 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).handle_message received message m=0x560c8ddec4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-27T16:39:01.786 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 queue 0x560c8ddec4e0 prio 196 2021-01-27T16:39:01.786 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 --2- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 0x560c8ddd7400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x560c8dde7e60 tx=0x560c8de1c240).read_frame 2021-01-27T16:39:01.787 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53619be700 20 -- 172.21.15.94:0/3760337145 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x560c8de6ac00 msgr2=0x560c8ddd7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-27T16:39:01.787 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53609bc700 1 -- 172.21.15.94:0/3760337145 <== mon.2 v2:172.21.15.94:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c8ddec4e0 con 0x560c8de6ac00 2021-01-27T16:39:01.787 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53609bc700 10 -- 172.21.15.94:0/3760337145 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-27T16:39:01.787 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.422+0000 7f53609bc700 20 -- 172.21.15.94:0/3760337145 done calling dispatch on 0x560c8ddec4e0 2021-01-27T16:39:02.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:01 smithi094 bash[20074]: debug 2021-01-27T16:39:01.970+0000 7f5368447200 -1 Falling back to public interface 2021-01-27T16:39:02.687 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:02 smithi094 bash[9811]: cluster 2021-01-27T16:39:01.363738+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:02.699 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:02 smithi106 bash[9795]: cluster 2021-01-27T16:39:01.363738+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:02.699 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:02 smithi106 bash[13484]: cluster 2021-01-27T16:39:01.363738+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:03.949 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:03 smithi106 bash[13484]: cluster 2021-01-27T16:39:03.364316+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:03.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:03 smithi106 bash[9795]: cluster 2021-01-27T16:39:03.364316+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:04.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:03 smithi094 bash[9811]: cluster 2021-01-27T16:39:03.364316+0000 mgr.y (mgr.14138) 238 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:04.594 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2021-01-27T16:39:04.594 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "ca27d811-ca55-4803-828a-6bdfdb64f6f8", 2021-01-27T16:39:04.594 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "realm", 2021-01-27T16:39:04.594 INFO:teuthology.orchestra.run.smithi094.stdout: "current_period": "50353b3b-019b-49fb-a85e-f0d83ca20134", 2021-01-27T16:39:04.595 INFO:teuthology.orchestra.run.smithi094.stdout: "epoch": 1 2021-01-27T16:39:04.595 INFO:teuthology.orchestra.run.smithi094.stdout:} 2021-01-27T16:39:04.938 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[9811]: cluster 2021-01-27T16:39:03.532975+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T16:39:04.938 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[9811]: audit 2021-01-27T16:39:03.533954+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:04.938 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[9811]: audit 2021-01-27T16:39:03.536629+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.94:0/2652989417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.939 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[9811]: audit 2021-01-27T16:39:03.543694+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.939 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[9811]: audit 2021-01-27T16:39:04.539329+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T16:39:04.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[9795]: cluster 2021-01-27T16:39:03.532975+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T16:39:04.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[9795]: audit 2021-01-27T16:39:03.533954+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:04.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[9795]: audit 2021-01-27T16:39:03.536629+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.94:0/2652989417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[9795]: audit 2021-01-27T16:39:03.543694+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[9795]: audit 2021-01-27T16:39:04.539329+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T16:39:04.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[13484]: cluster 2021-01-27T16:39:03.532975+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-27T16:39:04.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[13484]: audit 2021-01-27T16:39:03.533954+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:04.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[13484]: audit 2021-01-27T16:39:03.536629+0000 mon.b (mon.2) 12 : audit [INF] from='client.? 172.21.15.94:0/2652989417' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[13484]: audit 2021-01-27T16:39:03.543694+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-27T16:39:04.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:04 smithi106 bash[13484]: audit 2021-01-27T16:39:04.539329+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-27T16:39:05.282 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:04 smithi094 bash[20074]: debug 2021-01-27T16:39:04.949+0000 7f5368447200 -1 osd.7 0 log_to_monitors {default=true} 2021-01-27T16:39:05.693 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2021-01-27T16:39:05.889 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: cluster 2021-01-27T16:39:04.540006+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T16:39:05.889 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: audit 2021-01-27T16:39:04.540348+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:05.889 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: audit 2021-01-27T16:39:04.958040+0000 mon.b (mon.2) 13 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.890 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: audit 2021-01-27T16:39:04.958349+0000 mon.a (mon.0) 499 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.890 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: audit 2021-01-27T16:39:05.102106+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:05.890 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: cluster 2021-01-27T16:39:05.364942+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 4 creating+peering, 8 active+clean, 21 unknown; 161 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:05.890 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:05 smithi094 bash[9811]: audit 2021-01-27T16:39:05.461323+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:05.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: cluster 2021-01-27T16:39:04.540006+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T16:39:05.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: audit 2021-01-27T16:39:04.540348+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:05.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: audit 2021-01-27T16:39:04.958040+0000 mon.b (mon.2) 13 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: audit 2021-01-27T16:39:04.958349+0000 mon.a (mon.0) 499 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: audit 2021-01-27T16:39:05.102106+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:05.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: cluster 2021-01-27T16:39:05.364942+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 4 creating+peering, 8 active+clean, 21 unknown; 161 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:05.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[9795]: audit 2021-01-27T16:39:05.461323+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:05.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: cluster 2021-01-27T16:39:04.540006+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-27T16:39:05.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: audit 2021-01-27T16:39:04.540348+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:05.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: audit 2021-01-27T16:39:04.958040+0000 mon.b (mon.2) 13 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: audit 2021-01-27T16:39:04.958349+0000 mon.a (mon.0) 499 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-27T16:39:05.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: audit 2021-01-27T16:39:05.102106+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:05.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: cluster 2021-01-27T16:39:05.364942+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 4 creating+peering, 8 active+clean, 21 unknown; 161 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-27T16:39:05.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:05 smithi106 bash[13484]: audit 2021-01-27T16:39:05.461323+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: cephadm 2021-01-27T16:39:05.462930+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:39:06.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.559880+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T16:39:06.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: cluster 2021-01-27T16:39:05.560041+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T16:39:06.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.561240+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.562539+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.568575+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.888771+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: cephadm 2021-01-27T16:39:05.890544+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:06.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: audit 2021-01-27T16:39:05.899824+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[9795]: cephadm 2021-01-27T16:39:05.901268+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: cephadm 2021-01-27T16:39:05.462930+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:39:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.559880+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T16:39:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: cluster 2021-01-27T16:39:05.560041+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T16:39:06.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.561240+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:06.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.562539+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.568575+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.888771+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: cephadm 2021-01-27T16:39:05.890544+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:06.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: audit 2021-01-27T16:39:05.899824+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:06 smithi106 bash[13484]: cephadm 2021-01-27T16:39:05.901268+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:06.954 INFO:journalctl@ceph.osd.7.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[20074]: debug 2021-01-27T16:39:06.589+0000 7f535e9b8700 -1 osd.7 0 waiting for initial osdmap 2021-01-27T16:39:06.955 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: cephadm 2021-01-27T16:39:05.462930+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:39:06.955 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.559880+0000 mon.a (mon.0) 502 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-27T16:39:06.955 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: cluster 2021-01-27T16:39:05.560041+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-27T16:39:06.955 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.561240+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:06.956 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.562539+0000 mon.b (mon.2) 14 : audit [INF] from='osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.956 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.568575+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]: dispatch 2021-01-27T16:39:06.956 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.888771+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.956 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: cephadm 2021-01-27T16:39:05.890544+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:06.956 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: audit 2021-01-27T16:39:05.899824+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:06.957 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:06 smithi094 bash[9811]: cephadm 2021-01-27T16:39:05.901268+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:07.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: audit 2021-01-27T16:39:06.580744+0000 mon.a (mon.0) 508 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:39:07.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: cluster 2021-01-27T16:39:06.580961+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T16:39:07.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: audit 2021-01-27T16:39:06.585065+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: audit 2021-01-27T16:39:06.593333+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: cluster 2021-01-27T16:39:07.365804+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v208: 33 pgs: 4 peering, 4 creating+peering, 17 active+clean, 8 unknown; 277 B data, 37 MiB used, 626 GiB / 626 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-27T16:39:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: cluster 2021-01-27T16:39:07.575484+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326] boot 2021-01-27T16:39:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: cluster 2021-01-27T16:39:07.575587+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T16:39:07.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[9795]: audit 2021-01-27T16:39:07.575911+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: audit 2021-01-27T16:39:06.580744+0000 mon.a (mon.0) 508 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:39:07.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: cluster 2021-01-27T16:39:06.580961+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T16:39:07.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: audit 2021-01-27T16:39:06.585065+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: audit 2021-01-27T16:39:06.593333+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: cluster 2021-01-27T16:39:07.365804+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v208: 33 pgs: 4 peering, 4 creating+peering, 17 active+clean, 8 unknown; 277 B data, 37 MiB used, 626 GiB / 626 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-27T16:39:07.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: cluster 2021-01-27T16:39:07.575484+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326] boot 2021-01-27T16:39:07.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: cluster 2021-01-27T16:39:07.575587+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T16:39:07.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:07 smithi106 bash[13484]: audit 2021-01-27T16:39:07.575911+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.965 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: audit 2021-01-27T16:39:06.580744+0000 mon.a (mon.0) 508 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi094", "root=default"]}]': finished 2021-01-27T16:39:07.965 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: cluster 2021-01-27T16:39:06.580961+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-27T16:39:07.965 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: audit 2021-01-27T16:39:06.585065+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.965 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: audit 2021-01-27T16:39:06.593333+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:07.965 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: cluster 2021-01-27T16:39:07.365804+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v208: 33 pgs: 4 peering, 4 creating+peering, 17 active+clean, 8 unknown; 277 B data, 37 MiB used, 626 GiB / 626 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-27T16:39:07.966 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: cluster 2021-01-27T16:39:07.575484+0000 mon.a (mon.0) 512 : cluster [INF] osd.7 [v2:172.21.15.94:6824/974148326,v1:172.21.15.94:6825/974148326] boot 2021-01-27T16:39:07.966 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: cluster 2021-01-27T16:39:07.575587+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-27T16:39:07.966 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:07 smithi094 bash[9811]: audit 2021-01-27T16:39:07.575911+0000 mon.a (mon.0) 514 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-27T16:39:08.927 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:08 smithi094 bash[9811]: cluster 2021-01-27T16:39:05.986450+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:39:08.927 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:08 smithi094 bash[9811]: cluster 2021-01-27T16:39:05.986632+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:39:08.927 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:08 smithi094 bash[9811]: cluster 2021-01-27T16:39:07.944188+0000 mon.a (mon.0) 515 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:39:08.928 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:08 smithi094 bash[9811]: cluster 2021-01-27T16:39:08.582328+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T16:39:08.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[9795]: cluster 2021-01-27T16:39:05.986450+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:39:08.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[9795]: cluster 2021-01-27T16:39:05.986632+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:39:08.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[9795]: cluster 2021-01-27T16:39:07.944188+0000 mon.a (mon.0) 515 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:39:08.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[9795]: cluster 2021-01-27T16:39:08.582328+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T16:39:08.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[13484]: cluster 2021-01-27T16:39:05.986450+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-27T16:39:08.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[13484]: cluster 2021-01-27T16:39:05.986632+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-27T16:39:08.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[13484]: cluster 2021-01-27T16:39:07.944188+0000 mon.a (mon.0) 515 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-27T16:39:08.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:08 smithi106 bash[13484]: cluster 2021-01-27T16:39:08.582328+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-27T16:39:09.095 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2021-01-27T16:39:09.095 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "67435678-e0c2-409b-90c7-556767e89f18", 2021-01-27T16:39:09.096 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "default", 2021-01-27T16:39:09.096 INFO:teuthology.orchestra.run.smithi094.stdout: "api_name": "default", 2021-01-27T16:39:09.096 INFO:teuthology.orchestra.run.smithi094.stdout: "is_master": "true", 2021-01-27T16:39:09.096 INFO:teuthology.orchestra.run.smithi094.stdout: "endpoints": [], 2021-01-27T16:39:09.097 INFO:teuthology.orchestra.run.smithi094.stdout: "hostnames": [], 2021-01-27T16:39:09.097 INFO:teuthology.orchestra.run.smithi094.stdout: "hostnames_s3website": [], 2021-01-27T16:39:09.097 INFO:teuthology.orchestra.run.smithi094.stdout: "master_zone": "", 2021-01-27T16:39:09.097 INFO:teuthology.orchestra.run.smithi094.stdout: "zones": [], 2021-01-27T16:39:09.097 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_targets": [], 2021-01-27T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: "default_placement": "", 2021-01-27T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: "realm_id": "ca27d811-ca55-4803-828a-6bdfdb64f6f8", 2021-01-27T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: "sync_policy": { 2021-01-27T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: "groups": [] 2021-01-27T16:39:09.098 INFO:teuthology.orchestra.run.smithi094.stdout: } 2021-01-27T16:39:09.099 INFO:teuthology.orchestra.run.smithi094.stdout:} 2021-01-27T16:39:09.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:09 smithi106 bash[9795]: cluster 2021-01-27T16:39:09.366476+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v211: 33 pgs: 11 peering, 4 creating+peering, 18 active+clean; 126 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:39:09.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:09 smithi106 bash[13484]: cluster 2021-01-27T16:39:09.366476+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v211: 33 pgs: 11 peering, 4 creating+peering, 18 active+clean; 126 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:39:09.966 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:09 smithi094 bash[9811]: cluster 2021-01-27T16:39:09.366476+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v211: 33 pgs: 11 peering, 4 creating+peering, 18 active+clean; 126 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:39:09.966 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2021-01-27T16:39:10.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:10 smithi106 bash[9795]: cluster 2021-01-27T16:39:09.593074+0000 mon.a (mon.0) 517 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-01-27T16:39:10.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:10 smithi106 bash[9795]: cluster 2021-01-27T16:39:09.593164+0000 mon.a (mon.0) 518 : cluster [INF] Cluster is now healthy 2021-01-27T16:39:10.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:10 smithi106 bash[13484]: cluster 2021-01-27T16:39:09.593074+0000 mon.a (mon.0) 517 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-01-27T16:39:10.951 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:10 smithi106 bash[13484]: cluster 2021-01-27T16:39:09.593164+0000 mon.a (mon.0) 518 : cluster [INF] Cluster is now healthy 2021-01-27T16:39:11.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:10 smithi094 bash[9811]: cluster 2021-01-27T16:39:09.593074+0000 mon.a (mon.0) 517 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-01-27T16:39:11.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:10 smithi094 bash[9811]: cluster 2021-01-27T16:39:09.593164+0000 mon.a (mon.0) 518 : cluster [INF] Cluster is now healthy 2021-01-27T16:39:11.949 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:11 smithi106 bash[9795]: cluster 2021-01-27T16:39:11.367216+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v212: 33 pgs: 11 peering, 22 active+clean; 537 B data, 42 MiB used, 715 GiB / 715 GiB avail; 176 B/s rd, 0 op/s; 7 B/s, 0 objects/s recovering 2021-01-27T16:39:11.950 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:11 smithi106 bash[13484]: cluster 2021-01-27T16:39:11.367216+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v212: 33 pgs: 11 peering, 22 active+clean; 537 B data, 42 MiB used, 715 GiB / 715 GiB avail; 176 B/s rd, 0 op/s; 7 B/s, 0 objects/s recovering 2021-01-27T16:39:12.033 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:11 smithi094 bash[9811]: cluster 2021-01-27T16:39:11.367216+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v212: 33 pgs: 11 peering, 22 active+clean; 537 B data, 42 MiB used, 715 GiB / 715 GiB avail; 176 B/s rd, 0 op/s; 7 B/s, 0 objects/s recovering 2021-01-27T16:39:13.495 INFO:teuthology.orchestra.run.smithi094.stdout:{ 2021-01-27T16:39:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: "id": "95423068-48de-47b9-a47d-e5e4631ebadd", 2021-01-27T16:39:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: "name": "zone", 2021-01-27T16:39:13.495 INFO:teuthology.orchestra.run.smithi094.stdout: "domain_root": "zone.rgw.meta:root", 2021-01-27T16:39:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: "control_pool": "zone.rgw.control", 2021-01-27T16:39:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: "gc_pool": "zone.rgw.log:gc", 2021-01-27T16:39:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: "lc_pool": "zone.rgw.log:lc", 2021-01-27T16:39:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: "log_pool": "zone.rgw.log", 2021-01-27T16:39:13.496 INFO:teuthology.orchestra.run.smithi094.stdout: "intent_log_pool": "zone.rgw.log:intent", 2021-01-27T16:39:13.497 INFO:teuthology.orchestra.run.smithi094.stdout: "usage_log_pool": "zone.rgw.log:usage", 2021-01-27T16:39:13.497 INFO:teuthology.orchestra.run.smithi094.stdout: "roles_pool": "zone.rgw.meta:roles", 2021-01-27T16:39:13.497 INFO:teuthology.orchestra.run.smithi094.stdout: "reshard_pool": "zone.rgw.log:reshard", 2021-01-27T16:39:13.497 INFO:teuthology.orchestra.run.smithi094.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2021-01-27T16:39:13.498 INFO:teuthology.orchestra.run.smithi094.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2021-01-27T16:39:13.498 INFO:teuthology.orchestra.run.smithi094.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2021-01-27T16:39:13.498 INFO:teuthology.orchestra.run.smithi094.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2021-01-27T16:39:13.498 INFO:teuthology.orchestra.run.smithi094.stdout: "otp_pool": "zone.rgw.otp", 2021-01-27T16:39:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: "system_key": { 2021-01-27T16:39:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: "access_key": "", 2021-01-27T16:39:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: "secret_key": "" 2021-01-27T16:39:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2021-01-27T16:39:13.499 INFO:teuthology.orchestra.run.smithi094.stdout: "placement_pools": [ 2021-01-27T16:39:13.500 INFO:teuthology.orchestra.run.smithi094.stdout: { 2021-01-27T16:39:13.500 INFO:teuthology.orchestra.run.smithi094.stdout: "key": "default-placement", 2021-01-27T16:39:13.500 INFO:teuthology.orchestra.run.smithi094.stdout: "val": { 2021-01-27T16:39:13.500 INFO:teuthology.orchestra.run.smithi094.stdout: "index_pool": "zone.rgw.buckets.index", 2021-01-27T16:39:13.500 INFO:teuthology.orchestra.run.smithi094.stdout: "storage_classes": { 2021-01-27T16:39:13.501 INFO:teuthology.orchestra.run.smithi094.stdout: "STANDARD": { 2021-01-27T16:39:13.501 INFO:teuthology.orchestra.run.smithi094.stdout: "data_pool": "zone.rgw.buckets.data" 2021-01-27T16:39:13.501 INFO:teuthology.orchestra.run.smithi094.stdout: } 2021-01-27T16:39:13.501 INFO:teuthology.orchestra.run.smithi094.stdout: }, 2021-01-27T16:39:13.501 INFO:teuthology.orchestra.run.smithi094.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2021-01-27T16:39:13.502 INFO:teuthology.orchestra.run.smithi094.stdout: "index_type": 0 2021-01-27T16:39:13.502 INFO:teuthology.orchestra.run.smithi094.stdout: } 2021-01-27T16:39:13.502 INFO:teuthology.orchestra.run.smithi094.stdout: } 2021-01-27T16:39:13.502 INFO:teuthology.orchestra.run.smithi094.stdout: ], 2021-01-27T16:39:13.502 INFO:teuthology.orchestra.run.smithi094.stdout: "realm_id": "ca27d811-ca55-4803-828a-6bdfdb64f6f8", 2021-01-27T16:39:13.503 INFO:teuthology.orchestra.run.smithi094.stdout: "notif_pool": "zone.rgw.log:notif" 2021-01-27T16:39:13.503 INFO:teuthology.orchestra.run.smithi094.stdout:} 2021-01-27T16:39:14.355 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi106=realm.zone.a' 2021-01-27T16:39:14.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:14 smithi106 bash[9795]: cluster 2021-01-27T16:39:13.368037+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v213: 33 pgs: 1 peering, 32 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 603 B/s wr, 0 op/s; 39 B/s, 0 objects/s recovering 2021-01-27T16:39:14.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:14 smithi106 bash[13484]: cluster 2021-01-27T16:39:13.368037+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v213: 33 pgs: 1 peering, 32 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 603 B/s wr, 0 op/s; 39 B/s, 0 objects/s recovering 2021-01-27T16:39:14.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:14 smithi094 bash[9811]: cluster 2021-01-27T16:39:13.368037+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v213: 33 pgs: 1 peering, 32 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 301 B/s rd, 603 B/s wr, 0 op/s; 39 B/s, 0 objects/s recovering 2021-01-27T16:39:16.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:16 smithi106 bash[9795]: cluster 2021-01-27T16:39:15.368784+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 767 B/s wr, 1 op/s; 33 B/s, 0 objects/s recovering 2021-01-27T16:39:16.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:16 smithi106 bash[13484]: cluster 2021-01-27T16:39:15.368784+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 767 B/s wr, 1 op/s; 33 B/s, 0 objects/s recovering 2021-01-27T16:39:16.783 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:16 smithi094 bash[9811]: cluster 2021-01-27T16:39:15.368784+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 826 B data, 43 MiB used, 715 GiB / 715 GiB avail; 383 B/s rd, 767 B/s wr, 1 op/s; 33 B/s, 0 objects/s recovering 2021-01-27T16:39:18.034 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:17 smithi094 bash[9811]: cluster 2021-01-27T16:39:17.369528+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.0 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 418 B/s rd, 1.0 KiB/s wr, 1 op/s; 27 B/s, 0 objects/s recovering 2021-01-27T16:39:18.124 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled rgw.realm.zone update... 2021-01-27T16:39:18.450 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:17 smithi106 bash[9795]: cluster 2021-01-27T16:39:17.369528+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.0 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 418 B/s rd, 1.0 KiB/s wr, 1 op/s; 27 B/s, 0 objects/s recovering 2021-01-27T16:39:18.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:17 smithi106 bash[13484]: cluster 2021-01-27T16:39:17.369528+0000 mgr.y (mgr.14138) 248 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.0 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 418 B/s rd, 1.0 KiB/s wr, 1 op/s; 27 B/s, 0 objects/s recovering 2021-01-27T16:39:19.028 DEBUG:teuthology.orchestra.run.smithi106:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@rgw.realm.zone.a.service 2021-01-27T16:39:19.031 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi094 2021-01-27T16:39:19.032 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-01-27T16:39:19.111 INFO:journalctl@ceph.rgw.realm.zone.a.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:19.284 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.118128+0000 mgr.y (mgr.14138) 249 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi106=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:19.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: cephadm 2021-01-27T16:39:18.120045+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.126806+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.136218+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.285 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: cephadm 2021-01-27T16:39:18.137495+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: cephadm 2021-01-27T16:39:18.138593+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] 2021-01-27T16:39:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.139687+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:39:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.140987+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.147143+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T16:39:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.420273+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.427511+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.434165+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: cephadm 2021-01-27T16:39:18.435114+0000 mgr.y (mgr.14138) 253 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.439927+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.441093+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.442507+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:19.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: cephadm 2021-01-27T16:39:18.443415+0000 mgr.y (mgr.14138) 254 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi106 2021-01-27T16:39:19.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:19 smithi094 bash[9811]: audit 2021-01-27T16:39:18.444367+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:19.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.118128+0000 mgr.y (mgr.14138) 249 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi106=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:19.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: cephadm 2021-01-27T16:39:18.120045+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.126806+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.136218+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: cephadm 2021-01-27T16:39:18.137495+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:19.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: cephadm 2021-01-27T16:39:18.138593+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] 2021-01-27T16:39:19.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.139687+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:39:19.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.140987+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.452 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.147143+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T16:39:19.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.420273+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.427511+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.434165+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: cephadm 2021-01-27T16:39:18.435114+0000 mgr.y (mgr.14138) 253 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.439927+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.441093+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.442507+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: cephadm 2021-01-27T16:39:18.443415+0000 mgr.y (mgr.14138) 254 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi106 2021-01-27T16:39:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[9795]: audit 2021-01-27T16:39:18.444367+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.118128+0000 mgr.y (mgr.14138) 249 : audit [DBG] from='client.34355 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi106=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: cephadm 2021-01-27T16:39:18.120045+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.126806+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.136218+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: cephadm 2021-01-27T16:39:18.137495+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: cephadm 2021-01-27T16:39:18.138593+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] 2021-01-27T16:39:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.139687+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:39:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.140987+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.147143+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-27T16:39:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.420273+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.427511+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.434165+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: cephadm 2021-01-27T16:39:18.435114+0000 mgr.y (mgr.14138) 253 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi106=realm.zone.a;count:1 2021-01-27T16:39:19.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.439927+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:19.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.441093+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-27T16:39:19.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.442507+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:19.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: cephadm 2021-01-27T16:39:18.443415+0000 mgr.y (mgr.14138) 254 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi106 2021-01-27T16:39:19.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:19 smithi106 bash[13484]: audit 2021-01-27T16:39:18.444367+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:20.408 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:20 smithi106 bash[9795]: cluster 2021-01-27T16:39:19.370364+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 1.1 KiB/s wr, 1 op/s; 24 B/s, 0 objects/s recovering 2021-01-27T16:39:20.408 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:20 smithi106 bash[13484]: cluster 2021-01-27T16:39:19.370364+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 1.1 KiB/s wr, 1 op/s; 24 B/s, 0 objects/s recovering 2021-01-27T16:39:20.483 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:20 smithi094 bash[9811]: cluster 2021-01-27T16:39:19.370364+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 1.1 KiB/s wr, 1 op/s; 24 B/s, 0 objects/s recovering 2021-01-27T16:39:21.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:21 smithi094 bash[9811]: audit 2021-01-27T16:39:20.496368+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:21.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:21 smithi094 bash[9811]: cluster 2021-01-27T16:39:21.371055+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v217: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1023 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-27T16:39:21.826 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:21 smithi106 bash[9795]: audit 2021-01-27T16:39:20.496368+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:21.826 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:21 smithi106 bash[9795]: cluster 2021-01-27T16:39:21.371055+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v217: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1023 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-27T16:39:21.827 INFO:journalctl@ceph.rgw.realm.zone.a.smithi106.stdout:Jan 27 16:39:21 smithi106 systemd[1]: Started Ceph rgw.realm.zone.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:39:21.827 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:21 smithi106 bash[13484]: audit 2021-01-27T16:39:20.496368+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:21.827 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:21 smithi106 bash[13484]: cluster 2021-01-27T16:39:21.371055+0000 mgr.y (mgr.14138) 256 : cluster [DBG] pgmap v217: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1023 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-27T16:39:23.273 INFO:teuthology.orchestra.run.smithi094.stderr:pool 'iscsi' created 2021-01-27T16:39:23.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[13484]: audit 2021-01-27T16:39:21.770995+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:23.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[13484]: audit 2021-01-27T16:39:21.773251+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:23.451 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[13484]: audit 2021-01-27T16:39:22.757465+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.94:0/2253415242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:23.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[9795]: audit 2021-01-27T16:39:21.770995+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:23.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[9795]: audit 2021-01-27T16:39:21.773251+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:23.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:23 smithi106 bash[9795]: audit 2021-01-27T16:39:22.757465+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.94:0/2253415242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:23.503 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:23 smithi094 bash[9811]: audit 2021-01-27T16:39:21.770995+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:23.503 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:23 smithi094 bash[9811]: audit 2021-01-27T16:39:21.773251+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:23.503 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:23 smithi094 bash[9811]: audit 2021-01-27T16:39:22.757465+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.94:0/2253415242' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:24.178 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-01-27T16:39:24.534 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: audit 2021-01-27T16:39:22.758230+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:24.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: audit 2021-01-27T16:39:23.270515+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T16:39:24.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: cluster 2021-01-27T16:39:23.270761+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T16:39:24.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: audit 2021-01-27T16:39:23.275269+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: cephadm 2021-01-27T16:39:23.276022+0000 mgr.y (mgr.14138) 257 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:39:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: cluster 2021-01-27T16:39:23.371701+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v219: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 614 B/s wr, 1 op/s 2021-01-27T16:39:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: audit 2021-01-27T16:39:23.725772+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:24 smithi094 bash[9811]: audit 2021-01-27T16:39:23.735167+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: audit 2021-01-27T16:39:22.758230+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:24.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: audit 2021-01-27T16:39:23.270515+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T16:39:24.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: cluster 2021-01-27T16:39:23.270761+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T16:39:24.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: audit 2021-01-27T16:39:23.275269+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: cephadm 2021-01-27T16:39:23.276022+0000 mgr.y (mgr.14138) 257 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:39:24.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: cluster 2021-01-27T16:39:23.371701+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v219: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 614 B/s wr, 1 op/s 2021-01-27T16:39:24.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: audit 2021-01-27T16:39:23.725772+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[13484]: audit 2021-01-27T16:39:23.735167+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: audit 2021-01-27T16:39:22.758230+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-27T16:39:24.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: audit 2021-01-27T16:39:23.270515+0000 mon.a (mon.0) 535 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-27T16:39:24.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: cluster 2021-01-27T16:39:23.270761+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-27T16:39:24.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: audit 2021-01-27T16:39:23.275269+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: cephadm 2021-01-27T16:39:23.276022+0000 mgr.y (mgr.14138) 257 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:39:24.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: cluster 2021-01-27T16:39:23.371701+0000 mgr.y (mgr.14138) 258 : cluster [DBG] pgmap v219: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 614 B/s wr, 1 op/s 2021-01-27T16:39:24.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: audit 2021-01-27T16:39:23.725772+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:24.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:24 smithi106 bash[9795]: audit 2021-01-27T16:39:23.735167+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:25.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: cephadm 2021-01-27T16:39:23.726786+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: cephadm 2021-01-27T16:39:23.727362+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.600 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: cephadm 2021-01-27T16:39:23.736642+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.600 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: cephadm 2021-01-27T16:39:23.737692+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.600 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: cluster 2021-01-27T16:39:24.287638+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T16:39:25.600 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:25 smithi094 bash[9811]: audit 2021-01-27T16:39:24.298624+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T16:39:25.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: cephadm 2021-01-27T16:39:23.726786+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: cephadm 2021-01-27T16:39:23.727362+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: cephadm 2021-01-27T16:39:23.736642+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: cephadm 2021-01-27T16:39:23.737692+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: cluster 2021-01-27T16:39:24.287638+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T16:39:25.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[9795]: audit 2021-01-27T16:39:24.298624+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T16:39:25.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: cephadm 2021-01-27T16:39:23.726786+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: cephadm 2021-01-27T16:39:23.727362+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: cephadm 2021-01-27T16:39:23.736642+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:25.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: cephadm 2021-01-27T16:39:23.737692+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:25.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: cluster 2021-01-27T16:39:24.287638+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-27T16:39:25.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:25 smithi106 bash[13484]: audit 2021-01-27T16:39:24.298624+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-27T16:39:26.700 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[13484]: audit 2021-01-27T16:39:25.292760+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T16:39:26.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[13484]: cluster 2021-01-27T16:39:25.292943+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T16:39:26.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[13484]: cluster 2021-01-27T16:39:25.372283+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v222: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T16:39:26.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[13484]: audit 2021-01-27T16:39:25.728449+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:39:26.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[13484]: audit 2021-01-27T16:39:25.729171+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:39:26.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[9795]: audit 2021-01-27T16:39:25.292760+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T16:39:26.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[9795]: cluster 2021-01-27T16:39:25.292943+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T16:39:26.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[9795]: cluster 2021-01-27T16:39:25.372283+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v222: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T16:39:26.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[9795]: audit 2021-01-27T16:39:25.728449+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:39:26.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:26 smithi106 bash[9795]: audit 2021-01-27T16:39:25.729171+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:39:26.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:26 smithi094 bash[9811]: audit 2021-01-27T16:39:25.292760+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-27T16:39:26.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:26 smithi094 bash[9811]: cluster 2021-01-27T16:39:25.292943+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-27T16:39:26.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:26 smithi094 bash[9811]: cluster 2021-01-27T16:39:25.372283+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v222: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-27T16:39:26.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:26 smithi094 bash[9811]: audit 2021-01-27T16:39:25.728449+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:39:26.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:26 smithi094 bash[9811]: audit 2021-01-27T16:39:25.729171+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:39:27.700 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:27 smithi106 bash[9795]: cluster 2021-01-27T16:39:26.311429+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T16:39:27.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:27 smithi106 bash[9795]: audit 2021-01-27T16:39:26.315265+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T16:39:27.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:27 smithi106 bash[13484]: cluster 2021-01-27T16:39:26.311429+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T16:39:27.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:27 smithi106 bash[13484]: audit 2021-01-27T16:39:26.315265+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T16:39:27.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:27 smithi094 bash[9811]: cluster 2021-01-27T16:39:26.311429+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-27T16:39:27.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:27 smithi094 bash[9811]: audit 2021-01-27T16:39:26.315265+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-27T16:39:28.317 INFO:teuthology.orchestra.run.smithi094.stderr:enabled application 'rbd' on pool 'iscsi' 2021-01-27T16:39:28.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:28 smithi094 bash[9811]: audit 2021-01-27T16:39:27.315932+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T16:39:28.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:28 smithi094 bash[9811]: cluster 2021-01-27T16:39:27.316510+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T16:39:28.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:28 smithi094 bash[9811]: cluster 2021-01-27T16:39:27.372768+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v225: 100 pgs: 2 creating+activating, 13 creating+peering, 37 unknown, 48 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T16:39:28.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:28 smithi094 bash[9811]: audit 2021-01-27T16:39:27.836257+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.94:0/3316455222' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:28.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:28 smithi094 bash[9811]: audit 2021-01-27T16:39:27.837153+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:29.200 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[9795]: audit 2021-01-27T16:39:27.315932+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T16:39:29.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[9795]: cluster 2021-01-27T16:39:27.316510+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T16:39:29.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[9795]: cluster 2021-01-27T16:39:27.372768+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v225: 100 pgs: 2 creating+activating, 13 creating+peering, 37 unknown, 48 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T16:39:29.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[9795]: audit 2021-01-27T16:39:27.836257+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.94:0/3316455222' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:29.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[9795]: audit 2021-01-27T16:39:27.837153+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:29.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[13484]: audit 2021-01-27T16:39:27.315932+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.106:0/38008251' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-27T16:39:29.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[13484]: cluster 2021-01-27T16:39:27.316510+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-27T16:39:29.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[13484]: cluster 2021-01-27T16:39:27.372768+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v225: 100 pgs: 2 creating+activating, 13 creating+peering, 37 unknown, 48 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2021-01-27T16:39:29.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[13484]: audit 2021-01-27T16:39:27.836257+0000 mon.b (mon.2) 16 : audit [INF] from='client.? 172.21.15.94:0/3316455222' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:29.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:28 smithi106 bash[13484]: audit 2021-01-27T16:39:27.837153+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-27T16:39:29.276 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi094=iscsi.a' 2021-01-27T16:39:30.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:29 smithi094 bash[9811]: audit 2021-01-27T16:39:28.312600+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T16:39:30.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:29 smithi094 bash[9811]: cluster 2021-01-27T16:39:28.758556+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T16:39:30.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:29 smithi094 bash[9811]: cluster 2021-01-27T16:39:29.320154+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T16:39:30.035 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:29 smithi094 bash[9811]: audit 2021-01-27T16:39:29.330850+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T16:39:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:29 smithi094 bash[9811]: cluster 2021-01-27T16:39:29.373337+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v228: 132 pgs: 2 creating+activating, 13 creating+peering, 46 unknown, 71 active+clean; 7.2 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 37 op/s 2021-01-27T16:39:30.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[9795]: audit 2021-01-27T16:39:28.312600+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T16:39:30.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[9795]: cluster 2021-01-27T16:39:28.758556+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T16:39:30.201 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[9795]: cluster 2021-01-27T16:39:29.320154+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T16:39:30.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[9795]: audit 2021-01-27T16:39:29.330850+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T16:39:30.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[9795]: cluster 2021-01-27T16:39:29.373337+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v228: 132 pgs: 2 creating+activating, 13 creating+peering, 46 unknown, 71 active+clean; 7.2 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 37 op/s 2021-01-27T16:39:30.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[13484]: audit 2021-01-27T16:39:28.312600+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-27T16:39:30.202 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[13484]: cluster 2021-01-27T16:39:28.758556+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-27T16:39:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[13484]: cluster 2021-01-27T16:39:29.320154+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-27T16:39:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[13484]: audit 2021-01-27T16:39:29.330850+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-27T16:39:30.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:29 smithi106 bash[13484]: cluster 2021-01-27T16:39:29.373337+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v228: 132 pgs: 2 creating+activating, 13 creating+peering, 46 unknown, 71 active+clean; 7.2 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 37 op/s 2021-01-27T16:39:31.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[9795]: audit 2021-01-27T16:39:30.325104+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T16:39:31.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[9795]: cluster 2021-01-27T16:39:30.325231+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T16:39:31.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[9795]: audit 2021-01-27T16:39:30.328734+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T16:39:31.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[13484]: audit 2021-01-27T16:39:30.325104+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T16:39:31.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[13484]: cluster 2021-01-27T16:39:30.325231+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T16:39:31.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:31 smithi106 bash[13484]: audit 2021-01-27T16:39:30.328734+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T16:39:31.705 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:31 smithi094 bash[9811]: audit 2021-01-27T16:39:30.325104+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-27T16:39:31.705 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:31 smithi094 bash[9811]: cluster 2021-01-27T16:39:30.325231+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-27T16:39:31.705 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:31 smithi094 bash[9811]: audit 2021-01-27T16:39:30.328734+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-27T16:39:32.700 INFO:journalctl@ceph.rgw.realm.zone.a.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[25119]: debug 2021-01-27T16:39:32.498+0000 7f2e4b6642c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2021-01-27T16:39:32.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[9795]: audit 2021-01-27T16:39:31.329532+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T16:39:32.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[9795]: cluster 2021-01-27T16:39:31.329718+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T16:39:32.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[9795]: audit 2021-01-27T16:39:31.332299+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T16:39:32.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[9795]: cluster 2021-01-27T16:39:31.373977+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v231: 132 pgs: 12 creating+peering, 23 unknown, 97 active+clean; 11 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 15 KiB/s wr, 64 op/s 2021-01-27T16:39:32.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[13484]: audit 2021-01-27T16:39:31.329532+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T16:39:32.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[13484]: cluster 2021-01-27T16:39:31.329718+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T16:39:32.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[13484]: audit 2021-01-27T16:39:31.332299+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T16:39:32.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:32 smithi106 bash[13484]: cluster 2021-01-27T16:39:31.373977+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v231: 132 pgs: 12 creating+peering, 23 unknown, 97 active+clean; 11 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 15 KiB/s wr, 64 op/s 2021-01-27T16:39:32.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:32 smithi094 bash[9811]: audit 2021-01-27T16:39:31.329532+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-27T16:39:32.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:32 smithi094 bash[9811]: cluster 2021-01-27T16:39:31.329718+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-27T16:39:32.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:32 smithi094 bash[9811]: audit 2021-01-27T16:39:31.332299+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-27T16:39:32.782 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:32 smithi094 bash[9811]: cluster 2021-01-27T16:39:31.373977+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v231: 132 pgs: 12 creating+peering, 23 unknown, 97 active+clean; 11 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 15 KiB/s wr, 64 op/s 2021-01-27T16:39:33.243 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled iscsi.iscsi update... 2021-01-27T16:39:33.687 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:32.337985+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T16:39:33.688 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: cluster 2021-01-27T16:39:32.338188+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T16:39:33.688 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.245071+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.688 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.253467+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.688 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.270203+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.689 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.271576+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T16:39:33.689 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.279607+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T16:39:33.689 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.293987+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:33.689 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:33 smithi094 bash[9811]: audit 2021-01-27T16:39:33.295644+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:33.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:32.337985+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T16:39:33.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: cluster 2021-01-27T16:39:32.338188+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T16:39:33.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.245071+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.253467+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.270203+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.271576+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T16:39:33.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.279607+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T16:39:33.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.293987+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:33.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[13484]: audit 2021-01-27T16:39:33.295644+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:33.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:32.337985+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.106:0/1825161176' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-27T16:39:33.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: cluster 2021-01-27T16:39:32.338188+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-27T16:39:33.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.245071+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.253467+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.270203+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.271576+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-27T16:39:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.279607+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-27T16:39:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.293987+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-27T16:39:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:33 smithi106 bash[9795]: audit 2021-01-27T16:39:33.295644+0000 mon.a (mon.0) 569 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-27T16:39:34.599 DEBUG:teuthology.orchestra.run.smithi094:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@iscsi.iscsi.a.service 2021-01-27T16:39:34.601 INFO:tasks.cephadm:Adding prometheus.a on smithi094 2021-01-27T16:39:34.602 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply prometheus '1;smithi094=a' 2021-01-27T16:39:34.610 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: audit 2021-01-27T16:39:33.237210+0000 mgr.y (mgr.14138) 267 : audit [DBG] from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi094=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:34.610 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.239082+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.611 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.255515+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:34.611 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.256047+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:34.611 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.256589+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] 2021-01-27T16:39:34.611 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.256836+0000 mgr.y (mgr.14138) 272 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T16:39:34.612 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.265217+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.612 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cephadm 2021-01-27T16:39:33.295037+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi094 2021-01-27T16:39:34.612 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:34 smithi094 bash[9811]: cluster 2021-01-27T16:39:33.374939+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v233: 132 pgs: 5 creating+peering, 5 unknown, 122 active+clean; 22 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 23 KiB/s wr, 93 op/s 2021-01-27T16:39:34.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: audit 2021-01-27T16:39:33.237210+0000 mgr.y (mgr.14138) 267 : audit [DBG] from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi094=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:34.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.239082+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.255515+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:34.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.256047+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.256589+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] 2021-01-27T16:39:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.256836+0000 mgr.y (mgr.14138) 272 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T16:39:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.265217+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cephadm 2021-01-27T16:39:33.295037+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi094 2021-01-27T16:39:34.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[9795]: cluster 2021-01-27T16:39:33.374939+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v233: 132 pgs: 5 creating+peering, 5 unknown, 122 active+clean; 22 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 23 KiB/s wr, 93 op/s 2021-01-27T16:39:34.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: audit 2021-01-27T16:39:33.237210+0000 mgr.y (mgr.14138) 267 : audit [DBG] from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi094=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:34.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.239082+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.255515+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:34.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.256047+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.256589+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] 2021-01-27T16:39:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.256836+0000 mgr.y (mgr.14138) 272 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-27T16:39:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.265217+0000 mgr.y (mgr.14138) 273 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi094=iscsi.a;count:1 2021-01-27T16:39:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cephadm 2021-01-27T16:39:33.295037+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi094 2021-01-27T16:39:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:34 smithi106 bash[13484]: cluster 2021-01-27T16:39:33.374939+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v233: 132 pgs: 5 creating+peering, 5 unknown, 122 active+clean; 22 KiB data, 47 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 23 KiB/s wr, 93 op/s 2021-01-27T16:39:34.751 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:35.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:35 smithi106 bash[9795]: cluster 2021-01-27T16:39:34.373579+0000 mon.a (mon.0) 570 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-27T16:39:35.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:35 smithi106 bash[13484]: cluster 2021-01-27T16:39:34.373579+0000 mon.a (mon.0) 570 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-27T16:39:35.784 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:35 smithi094 bash[9811]: cluster 2021-01-27T16:39:34.373579+0000 mon.a (mon.0) 570 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-27T16:39:36.448 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:36 smithi094 bash[9811]: cluster 2021-01-27T16:39:35.375887+0000 mgr.y (mgr.14138) 276 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 19 KiB/s wr, 151 op/s 2021-01-27T16:39:36.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:36 smithi106 bash[9795]: cluster 2021-01-27T16:39:35.375887+0000 mgr.y (mgr.14138) 276 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 19 KiB/s wr, 151 op/s 2021-01-27T16:39:36.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:36 smithi106 bash[13484]: cluster 2021-01-27T16:39:35.375887+0000 mgr.y (mgr.14138) 276 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 19 KiB/s wr, 151 op/s 2021-01-27T16:39:38.264 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:37 smithi094 bash[9811]: cluster 2021-01-27T16:39:37.376905+0000 mgr.y (mgr.14138) 277 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 15 KiB/s wr, 182 op/s 2021-01-27T16:39:38.450 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:37 smithi106 bash[13484]: cluster 2021-01-27T16:39:37.376905+0000 mgr.y (mgr.14138) 277 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 15 KiB/s wr, 182 op/s 2021-01-27T16:39:38.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:37 smithi106 bash[9795]: cluster 2021-01-27T16:39:37.376905+0000 mgr.y (mgr.14138) 277 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s rd, 15 KiB/s wr, 182 op/s 2021-01-27T16:39:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:39 smithi094 bash[9811]: audit 2021-01-27T16:39:38.387100+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:39.535 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:39 smithi094 bash[9811]: audit 2021-01-27T16:39:38.389614+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:39.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:39 smithi106 bash[13484]: audit 2021-01-27T16:39:38.387100+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:39.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:39 smithi106 bash[13484]: audit 2021-01-27T16:39:38.389614+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:39.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:39 smithi106 bash[9795]: audit 2021-01-27T16:39:38.387100+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:39.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:39 smithi106 bash[9795]: audit 2021-01-27T16:39:38.389614+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:39:40.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: cluster 2021-01-27T16:39:39.378109+0000 mgr.y (mgr.14138) 278 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 12 KiB/s wr, 169 op/s 2021-01-27T16:39:40.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.214848+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.221574+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.231148+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:40.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.235938+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:40.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.242305+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.245970+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:40.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.260796+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[9795]: audit 2021-01-27T16:39:40.267966+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: cluster 2021-01-27T16:39:39.378109+0000 mgr.y (mgr.14138) 278 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 12 KiB/s wr, 169 op/s 2021-01-27T16:39:40.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.214848+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.221574+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.231148+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:40.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.235938+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:40.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.242305+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.245970+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:40.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.260796+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:40 smithi106 bash[13484]: audit 2021-01-27T16:39:40.267966+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: cluster 2021-01-27T16:39:39.378109+0000 mgr.y (mgr.14138) 278 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 12 KiB/s wr, 169 op/s 2021-01-27T16:39:40.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.214848+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.221574+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.231148+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.235938+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.242305+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.245970+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:40.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.260796+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[9811]: audit 2021-01-27T16:39:40.267966+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:40.799 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled prometheus update... 2021-01-27T16:39:41.046 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:40 smithi094 bash[22020]: log file path now is '/var/log/tcmu-runner.log' 2021-01-27T16:39:41.509 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug Started the configuration object watcher 2021-01-27T16:39:41.510 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.223033+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.510 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.223947+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.510 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.224805+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.510 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: audit 2021-01-27T16:39:40.231966+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:41.511 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.235465+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.94:5000 to Dashboard 2021-01-27T16:39:41.511 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: audit 2021-01-27T16:39:40.236455+0000 mgr.y (mgr.14138) 284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:41.511 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: audit 2021-01-27T16:39:40.246710+0000 mgr.y (mgr.14138) 285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:41.511 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.269422+0000 mgr.y (mgr.14138) 286 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.512 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.270282+0000 mgr.y (mgr.14138) 287 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.512 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.271112+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.512 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: audit 2021-01-27T16:39:40.800022+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.512 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[9811]: audit 2021-01-27T16:39:40.809500+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.223033+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.223947+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.224805+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: audit 2021-01-27T16:39:40.231966+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:41.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.235465+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.94:5000 to Dashboard 2021-01-27T16:39:41.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: audit 2021-01-27T16:39:40.236455+0000 mgr.y (mgr.14138) 284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:41.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: audit 2021-01-27T16:39:40.246710+0000 mgr.y (mgr.14138) 285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:41.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.269422+0000 mgr.y (mgr.14138) 286 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.270282+0000 mgr.y (mgr.14138) 287 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.271112+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: audit 2021-01-27T16:39:40.800022+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[13484]: audit 2021-01-27T16:39:40.809500+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.223033+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.223947+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.224805+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: audit 2021-01-27T16:39:40.231966+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-27T16:39:41.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.235465+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.94:5000 to Dashboard 2021-01-27T16:39:41.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: audit 2021-01-27T16:39:40.236455+0000 mgr.y (mgr.14138) 284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-27T16:39:41.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: audit 2021-01-27T16:39:40.246710+0000 mgr.y (mgr.14138) 285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi094"}]: dispatch 2021-01-27T16:39:41.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.269422+0000 mgr.y (mgr.14138) 286 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:41.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.270282+0000 mgr.y (mgr.14138) 287 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:41.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.271112+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:41.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: audit 2021-01-27T16:39:40.800022+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:41 smithi106 bash[9795]: audit 2021-01-27T16:39:40.809500+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:41.785 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug Checking for config object changes every 1s 2021-01-27T16:39:41.785 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug Processing osd blocklist entries for this node 2021-01-27T16:39:41.825 DEBUG:teuthology.orchestra.run.smithi094:prometheus.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@prometheus.a.service 2021-01-27T16:39:41.827 INFO:tasks.cephadm:Adding node-exporter.a on smithi106 2021-01-27T16:39:41.827 INFO:tasks.cephadm:Adding node-exporter.b on smithi094 2021-01-27T16:39:41.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply node-exporter '2;smithi106=a;smithi094=b' 2021-01-27T16:39:41.846 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:42.285 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug Reading the configuration object to update local LIO configuration 2021-01-27T16:39:42.285 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug Configuration does not have an entry for this host(smithi094.front.sepia.ceph.com) - nothing to define to LIO 2021-01-27T16:39:42.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:41 smithi094 bash[22046]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-01-27T16:39:42.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: audit 2021-01-27T16:39:40.791223+0000 mgr.y (mgr.14138) 289 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:42.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.793512+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Saving service prometheus spec with placement smithi094=a;count:1 2021-01-27T16:39:42.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.811412+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:42.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.812434+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:42.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.813386+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:42.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.814392+0000 mgr.y (mgr.14138) 294 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:39:42.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cephadm 2021-01-27T16:39:40.824538+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Deploying daemon prometheus.a on smithi094 2021-01-27T16:39:42.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: cluster 2021-01-27T16:39:41.379263+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 9.8 KiB/s wr, 136 op/s 2021-01-27T16:39:42.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[9795]: audit 2021-01-27T16:39:41.874039+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.94:0/4118806244' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T16:39:42.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: audit 2021-01-27T16:39:40.791223+0000 mgr.y (mgr.14138) 289 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:42.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.793512+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Saving service prometheus spec with placement smithi094=a;count:1 2021-01-27T16:39:42.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.811412+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:42.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.812434+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:42.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.813386+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:42.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.814392+0000 mgr.y (mgr.14138) 294 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:39:42.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cephadm 2021-01-27T16:39:40.824538+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Deploying daemon prometheus.a on smithi094 2021-01-27T16:39:42.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: cluster 2021-01-27T16:39:41.379263+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 9.8 KiB/s wr, 136 op/s 2021-01-27T16:39:42.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:42 smithi106 bash[13484]: audit 2021-01-27T16:39:41.874039+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.94:0/4118806244' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T16:39:42.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: audit 2021-01-27T16:39:40.791223+0000 mgr.y (mgr.14138) 289 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:42.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.793512+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Saving service prometheus spec with placement smithi094=a;count:1 2021-01-27T16:39:42.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.811412+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:39:42.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.812434+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:39:42.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.813386+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:39:42.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.814392+0000 mgr.y (mgr.14138) 294 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:39:42.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cephadm 2021-01-27T16:39:40.824538+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Deploying daemon prometheus.a on smithi094 2021-01-27T16:39:42.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: cluster 2021-01-27T16:39:41.379263+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s rd, 9.8 KiB/s wr, 136 op/s 2021-01-27T16:39:42.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:42 smithi094 bash[9811]: audit 2021-01-27T16:39:41.874039+0000 mon.b (mon.2) 17 : audit [DBG] from='client.? 172.21.15.94:0/4118806244' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-27T16:39:44.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:44 smithi106 bash[13484]: cluster 2021-01-27T16:39:43.380312+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 4.1 KiB/s wr, 104 op/s 2021-01-27T16:39:44.701 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:44 smithi106 bash[9795]: cluster 2021-01-27T16:39:43.380312+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 4.1 KiB/s wr, 104 op/s 2021-01-27T16:39:44.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:44 smithi094 bash[9811]: cluster 2021-01-27T16:39:43.380312+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 4.1 KiB/s wr, 104 op/s 2021-01-27T16:39:46.701 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:46 smithi106 bash[13484]: cluster 2021-01-27T16:39:45.381468+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.6 KiB/s wr, 92 op/s 2021-01-27T16:39:46.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:46 smithi106 bash[9795]: cluster 2021-01-27T16:39:45.381468+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.6 KiB/s wr, 92 op/s 2021-01-27T16:39:46.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:46 smithi094 bash[9811]: cluster 2021-01-27T16:39:45.381468+0000 mgr.y (mgr.14138) 298 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 2.6 KiB/s wr, 92 op/s 2021-01-27T16:39:48.228 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:47 smithi094 bash[9811]: cluster 2021-01-27T16:39:47.382678+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.2 KiB/s wr, 47 op/s 2021-01-27T16:39:48.451 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:47 smithi106 bash[9795]: cluster 2021-01-27T16:39:47.382678+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.2 KiB/s wr, 47 op/s 2021-01-27T16:39:48.452 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:47 smithi106 bash[13484]: cluster 2021-01-27T16:39:47.382678+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 1.2 KiB/s wr, 47 op/s 2021-01-27T16:39:48.667 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled node-exporter update... 2021-01-27T16:39:49.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[13484]: audit 2021-01-27T16:39:48.659367+0000 mgr.y (mgr.14138) 300 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi106=a;smithi094=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:49.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[13484]: cephadm 2021-01-27T16:39:48.660628+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Saving service node-exporter spec with placement smithi106=a;smithi094=b;count:2 2021-01-27T16:39:49.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[13484]: audit 2021-01-27T16:39:48.667069+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:49.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[13484]: cluster 2021-01-27T16:39:49.383798+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2021-01-27T16:39:49.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[9795]: audit 2021-01-27T16:39:48.659367+0000 mgr.y (mgr.14138) 300 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi106=a;smithi094=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:49.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[9795]: cephadm 2021-01-27T16:39:48.660628+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Saving service node-exporter spec with placement smithi106=a;smithi094=b;count:2 2021-01-27T16:39:49.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[9795]: audit 2021-01-27T16:39:48.667069+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:49.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:49 smithi106 bash[9795]: cluster 2021-01-27T16:39:49.383798+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2021-01-27T16:39:49.969 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:49 smithi094 bash[9811]: audit 2021-01-27T16:39:48.659367+0000 mgr.y (mgr.14138) 300 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi106=a;smithi094=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:49.970 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:49 smithi094 bash[9811]: cephadm 2021-01-27T16:39:48.660628+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Saving service node-exporter spec with placement smithi106=a;smithi094=b;count:2 2021-01-27T16:39:49.970 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:49 smithi094 bash[9811]: audit 2021-01-27T16:39:48.667069+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:49.970 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:49 smithi094 bash[9811]: cluster 2021-01-27T16:39:49.383798+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2021-01-27T16:39:49.971 DEBUG:teuthology.orchestra.run.smithi106:node-exporter.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@node-exporter.a.service 2021-01-27T16:39:49.974 DEBUG:teuthology.orchestra.run.smithi094:node-exporter.b> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@node-exporter.b.service 2021-01-27T16:39:49.977 INFO:tasks.cephadm:Adding alertmanager.a on smithi106 2021-01-27T16:39:49.978 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply alertmanager '1;smithi106=a' 2021-01-27T16:39:49.996 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:50.010 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:51.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:39:51 smithi106 bash[10032]: debug 2021-01-27T16:39:51.533+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:39:52.035 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:39:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:39:52.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:52 smithi106 bash[9795]: cluster 2021-01-27T16:39:51.384768+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:52.702 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:52 smithi106 bash[13484]: cluster 2021-01-27T16:39:51.384768+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:52.708 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:52 smithi094 bash[9811]: cluster 2021-01-27T16:39:51.384768+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:53.702 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:53 smithi106 bash[9795]: audit 2021-01-27T16:39:51.538485+0000 mgr.y (mgr.14138) 304 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:39:53.711 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:53 smithi106 bash[13484]: audit 2021-01-27T16:39:51.538485+0000 mgr.y (mgr.14138) 304 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:39:53.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:53 smithi094 bash[9811]: audit 2021-01-27T16:39:51.538485+0000 mgr.y (mgr.14138) 304 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:39:54.811 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:54 smithi094 bash[9811]: cluster 2021-01-27T16:39:53.386040+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:54.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:54 smithi106 bash[9795]: cluster 2021-01-27T16:39:53.386040+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:54.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:54 smithi106 bash[13484]: cluster 2021-01-27T16:39:53.386040+0000 mgr.y (mgr.14138) 305 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:56.713 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled alertmanager update... 2021-01-27T16:39:56.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:56 smithi094 bash[9811]: cluster 2021-01-27T16:39:55.387112+0000 mgr.y (mgr.14138) 306 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:56.952 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:56 smithi106 bash[9795]: cluster 2021-01-27T16:39:55.387112+0000 mgr.y (mgr.14138) 306 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:56.953 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:56 smithi106 bash[13484]: cluster 2021-01-27T16:39:55.387112+0000 mgr.y (mgr.14138) 306 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-01-27T16:39:57.779 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:57 smithi094 bash[9811]: audit 2021-01-27T16:39:56.701771+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:57.779 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:57 smithi094 bash[9811]: cephadm 2021-01-27T16:39:56.703978+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service alertmanager spec with placement smithi106=a;count:1 2021-01-27T16:39:57.779 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:57 smithi094 bash[9811]: audit 2021-01-27T16:39:56.713011+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:57.780 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:39:57 smithi094 bash[9811]: cluster 2021-01-27T16:39:57.388206+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:39:57.781 DEBUG:teuthology.orchestra.run.smithi106:alertmanager.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@alertmanager.a.service 2021-01-27T16:39:57.783 INFO:tasks.cephadm:Adding grafana.a on smithi094 2021-01-27T16:39:57.784 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph orch apply grafana '1;smithi094=a' 2021-01-27T16:39:57.832 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:39:58.202 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[9795]: audit 2021-01-27T16:39:56.701771+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:58.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[9795]: cephadm 2021-01-27T16:39:56.703978+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service alertmanager spec with placement smithi106=a;count:1 2021-01-27T16:39:58.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[9795]: audit 2021-01-27T16:39:56.713011+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:58.203 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[9795]: cluster 2021-01-27T16:39:57.388206+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:39:58.203 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[13484]: audit 2021-01-27T16:39:56.701771+0000 mgr.y (mgr.14138) 307 : audit [DBG] from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi106=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:39:58.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[13484]: cephadm 2021-01-27T16:39:56.703978+0000 mgr.y (mgr.14138) 308 : cephadm [INF] Saving service alertmanager spec with placement smithi106=a;count:1 2021-01-27T16:39:58.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[13484]: audit 2021-01-27T16:39:56.713011+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:39:58.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:39:57 smithi106 bash[13484]: cluster 2021-01-27T16:39:57.388206+0000 mgr.y (mgr.14138) 309 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:00.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[9795]: cluster 2021-01-27T16:39:59.389238+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:00.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[9795]: audit 2021-01-27T16:39:59.536932+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:00.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[9795]: audit 2021-01-27T16:39:59.539847+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:00.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[9795]: cluster 2021-01-27T16:40:00.000161+0000 mon.a (mon.0) 587 : cluster [INF] overall HEALTH_OK 2021-01-27T16:40:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[13484]: cluster 2021-01-27T16:39:59.389238+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[13484]: audit 2021-01-27T16:39:59.536932+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[13484]: audit 2021-01-27T16:39:59.539847+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:00 smithi106 bash[13484]: cluster 2021-01-27T16:40:00.000161+0000 mon.a (mon.0) 587 : cluster [INF] overall HEALTH_OK 2021-01-27T16:40:00.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:00 smithi094 bash[9811]: cluster 2021-01-27T16:39:59.389238+0000 mgr.y (mgr.14138) 310 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:00.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:00 smithi094 bash[9811]: audit 2021-01-27T16:39:59.536932+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:00.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:00 smithi094 bash[9811]: audit 2021-01-27T16:39:59.539847+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:00.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:00 smithi094 bash[9811]: cluster 2021-01-27T16:40:00.000161+0000 mon.a (mon.0) 587 : cluster [INF] overall HEALTH_OK 2021-01-27T16:40:01.786 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:01.953 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:01 smithi106 bash[10032]: debug 2021-01-27T16:40:01.540+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:02.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:02 smithi094 bash[9811]: cluster 2021-01-27T16:40:01.390240+0000 mgr.y (mgr.14138) 311 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:02.536 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:02 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:02.358Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T16:40:02.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:02 smithi106 bash[9795]: cluster 2021-01-27T16:40:01.390240+0000 mgr.y (mgr.14138) 311 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:02.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:02 smithi106 bash[13484]: cluster 2021-01-27T16:40:01.390240+0000 mgr.y (mgr.14138) 311 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:03.712 INFO:teuthology.orchestra.run.smithi094.stdout:Scheduled grafana update... 2021-01-27T16:40:03.722 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[9795]: audit 2021-01-27T16:40:01.545960+0000 mgr.y (mgr.14138) 312 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:03.723 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[9795]: audit 2021-01-27T16:40:03.123001+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:03.723 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[9795]: audit 2021-01-27T16:40:03.132125+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:03.723 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[13484]: audit 2021-01-27T16:40:01.545960+0000 mgr.y (mgr.14138) 312 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:03.723 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[13484]: audit 2021-01-27T16:40:03.123001+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:03.724 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:03 smithi106 bash[13484]: audit 2021-01-27T16:40:03.132125+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:03.763 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:03 smithi094 bash[9811]: audit 2021-01-27T16:40:01.545960+0000 mgr.y (mgr.14138) 312 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:03.764 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:03 smithi094 bash[9811]: audit 2021-01-27T16:40:03.123001+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:03.764 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:03 smithi094 bash[9811]: audit 2021-01-27T16:40:03.132125+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.049 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:03 smithi106 systemd[1]: Started Ceph node-exporter.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:04.359 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T16:40:04.631 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.133489+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:04.631 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.134387+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:04.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.135221+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:04.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.136100+0000 mgr.y (mgr.14138) 316 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:04.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.137076+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='b'), HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:04.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.137677+0000 mgr.y (mgr.14138) 318 : cephadm [INF] Deploying daemon node-exporter.a on smithi106 2021-01-27T16:40:04.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: cluster 2021-01-27T16:40:03.391362+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:04.633 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: audit 2021-01-27T16:40:03.711782+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.633 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[9811]: audit 2021-01-27T16:40:03.997913+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.633 DEBUG:teuthology.orchestra.run.smithi094:grafana.a> sudo journalctl -f -n 0 -u ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@grafana.a.service 2021-01-27T16:40:04.636 INFO:tasks.cephadm:Setting up client nodes... 2021-01-27T16:40:04.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T16:40:04.651 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T16:40:04.651 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 49a2d53aa1af: Pulling fs layer 2021-01-27T16:40:04.651 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 3589a6efd9ce: Pulling fs layer 2021-01-27T16:40:04.652 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 190160031744: Pulling fs layer 2021-01-27T16:40:04.652 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 3589a6efd9ce: Verifying Checksum 2021-01-27T16:40:04.652 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 3589a6efd9ce: Download complete 2021-01-27T16:40:04.652 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 49a2d53aa1af: Verifying Checksum 2021-01-27T16:40:04.652 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 49a2d53aa1af: Download complete 2021-01-27T16:40:04.653 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 190160031744: Verifying Checksum 2021-01-27T16:40:04.653 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 190160031744: Download complete 2021-01-27T16:40:04.653 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.133489+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:04.653 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.134387+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:04.654 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.135221+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:04.654 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.136100+0000 mgr.y (mgr.14138) 316 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:04.654 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.137076+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='b'), HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:04.654 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.137677+0000 mgr.y (mgr.14138) 318 : cephadm [INF] Deploying daemon node-exporter.a on smithi106 2021-01-27T16:40:04.655 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: cluster 2021-01-27T16:40:03.391362+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:04.655 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: audit 2021-01-27T16:40:03.711782+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.655 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[9795]: audit 2021-01-27T16:40:03.997913+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.655 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.133489+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:04.655 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.134387+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:04.656 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.135221+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:04.656 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.136100+0000 mgr.y (mgr.14138) 316 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:04.656 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.137076+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='b'), HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:04.656 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.137677+0000 mgr.y (mgr.14138) 318 : cephadm [INF] Deploying daemon node-exporter.a on smithi106 2021-01-27T16:40:04.657 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: cluster 2021-01-27T16:40:03.391362+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:04.657 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: audit 2021-01-27T16:40:03.711782+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.657 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[13484]: audit 2021-01-27T16:40:03.997913+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:04.657 INFO:journalctl@ceph.grafana.a.smithi094.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-27T16:40:04.915 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:04 smithi094 systemd[1]: Started Ceph node-exporter.b for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:04.952 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:04 smithi106 bash[26091]: 49a2d53aa1af: Pull complete 2021-01-27T16:40:05.210 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:04 smithi094 bash[23693]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-27T16:40:05.210 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: v0.18.1: Pulling from prom/node-exporter 2021-01-27T16:40:05.211 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 49a2d53aa1af: Pulling fs layer 2021-01-27T16:40:05.211 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 3589a6efd9ce: Pulling fs layer 2021-01-27T16:40:05.211 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 190160031744: Pulling fs layer 2021-01-27T16:40:05.212 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 3589a6efd9ce: Download complete 2021-01-27T16:40:05.461 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 49a2d53aa1af: Download complete 2021-01-27T16:40:05.461 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 190160031744: Verifying Checksum 2021-01-27T16:40:05.462 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 190160031744: Download complete 2021-01-27T16:40:05.786 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 49a2d53aa1af: Pull complete 2021-01-27T16:40:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[9811]: audit 2021-01-27T16:40:03.704913+0000 mgr.y (mgr.14138) 320 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:40:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.706827+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Saving service grafana spec with placement smithi094=a;count:1 2021-01-27T16:40:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[9811]: cephadm 2021-01-27T16:40:03.998950+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Deploying daemon node-exporter.b on smithi094 2021-01-27T16:40:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[9811]: audit 2021-01-27T16:40:04.867533+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:05.895 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[9795]: audit 2021-01-27T16:40:03.704913+0000 mgr.y (mgr.14138) 320 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:40:05.896 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.706827+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Saving service grafana spec with placement smithi094=a;count:1 2021-01-27T16:40:05.896 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[9795]: cephadm 2021-01-27T16:40:03.998950+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Deploying daemon node-exporter.b on smithi094 2021-01-27T16:40:05.896 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[9795]: audit 2021-01-27T16:40:04.867533+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:05.896 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[13484]: audit 2021-01-27T16:40:03.704913+0000 mgr.y (mgr.14138) 320 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi094=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-27T16:40:05.897 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.706827+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Saving service grafana spec with placement smithi094=a;count:1 2021-01-27T16:40:05.897 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[13484]: cephadm 2021-01-27T16:40:03.998950+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Deploying daemon node-exporter.b on smithi094 2021-01-27T16:40:05.897 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[13484]: audit 2021-01-27T16:40:04.867533+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:06.203 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:05 smithi106 bash[26091]: 3589a6efd9ce: Pull complete 2021-01-27T16:40:06.259 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:05 smithi094 bash[23693]: 3589a6efd9ce: Pull complete 2021-01-27T16:40:06.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[9811]: cephadm 2021-01-27T16:40:04.869076+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:06.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[9811]: cephadm 2021-01-27T16:40:04.876292+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Deploying daemon alertmanager.a on smithi106 2021-01-27T16:40:06.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[9811]: cluster 2021-01-27T16:40:05.392431+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:06.537 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[23693]: 190160031744: Pull complete 2021-01-27T16:40:06.537 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[23693]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T16:40:06.537 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:06 smithi094 bash[23693]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T16:40:06.950 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[9795]: cephadm 2021-01-27T16:40:04.869076+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[9795]: cephadm 2021-01-27T16:40:04.876292+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Deploying daemon alertmanager.a on smithi106 2021-01-27T16:40:06.951 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[9795]: cluster 2021-01-27T16:40:05.392431+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[13484]: cephadm 2021-01-27T16:40:04.869076+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi106', network='', name='a')] 2021-01-27T16:40:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[13484]: cephadm 2021-01-27T16:40:04.876292+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Deploying daemon alertmanager.a on smithi106 2021-01-27T16:40:06.952 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[13484]: cluster 2021-01-27T16:40:05.392431+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:07.207 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:06 smithi106 bash[26091]: 190160031744: Pull complete 2021-01-27T16:40:07.207 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:07 smithi106 bash[26091]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-27T16:40:07.706 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:07 smithi106 bash[26091]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-27T16:40:08.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:07 smithi094 bash[9811]: cluster 2021-01-27T16:40:07.393537+0000 mgr.y (mgr.14138) 326 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:08.286 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T16:40:08.287 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T16:40:08.287 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T16:40:08.287 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T16:40:08.287 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T16:40:08.287 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T16:40:08.288 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T16:40:08.288 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T16:40:08.288 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T16:40:08.288 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T16:40:08.288 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T16:40:08.289 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T16:40:08.289 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T16:40:08.289 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T16:40:08.289 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T16:40:08.289 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T16:40:08.290 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T16:40:08.290 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T16:40:08.290 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T16:40:08.290 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T16:40:08.291 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T16:40:08.291 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T16:40:08.291 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T16:40:08.291 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T16:40:08.291 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T16:40:08.292 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T16:40:08.292 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T16:40:08.292 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T16:40:08.292 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T16:40:08.292 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T16:40:08.293 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T16:40:08.293 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T16:40:08.293 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T16:40:08.293 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T16:40:08.293 INFO:journalctl@ceph.node-exporter.b.smithi094.stdout:Jan 27 16:40:08 smithi094 bash[23693]: time="2021-01-27T16:40:08Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T16:40:08.347 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:07 smithi106 bash[9795]: cluster 2021-01-27T16:40:07.393537+0000 mgr.y (mgr.14138) 326 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:08.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:07 smithi106 bash[13484]: cluster 2021-01-27T16:40:07.393537+0000 mgr.y (mgr.14138) 326 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:10.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:10 smithi106 bash[9795]: cluster 2021-01-27T16:40:09.394649+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:10.703 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:10 smithi106 bash[13484]: cluster 2021-01-27T16:40:09.394649+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:10.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:10 smithi094 bash[9811]: cluster 2021-01-27T16:40:09.394649+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:11.454 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-27T16:40:11.455 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-27T16:40:11.455 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-27T16:40:11.455 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-27T16:40:11.455 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-27T16:40:11.456 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-27T16:40:11.456 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-27T16:40:11.456 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-27T16:40:11.456 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-27T16:40:11.456 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-27T16:40:11.457 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-27T16:40:11.457 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-27T16:40:11.457 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-27T16:40:11.457 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-27T16:40:11.457 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-27T16:40:11.458 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-27T16:40:11.458 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-27T16:40:11.458 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-27T16:40:11.458 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-27T16:40:11.458 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-27T16:40:11.459 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-27T16:40:11.459 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-27T16:40:11.459 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-27T16:40:11.459 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-27T16:40:11.459 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-27T16:40:11.460 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-27T16:40:11.460 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-27T16:40:11.460 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-27T16:40:11.460 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-27T16:40:11.460 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-27T16:40:11.461 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-27T16:40:11.461 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-27T16:40:11.461 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-27T16:40:11.461 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-27T16:40:11.461 INFO:journalctl@ceph.node-exporter.a.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[26091]: time="2021-01-27T16:40:11Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-27T16:40:11.953 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:11 smithi106 bash[10032]: debug 2021-01-27T16:40:11.555+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:12.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:12.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:12 smithi094 bash[9811]: cluster 2021-01-27T16:40:11.395741+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:12.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:12 smithi106 bash[9795]: cluster 2021-01-27T16:40:11.395741+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:12.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:12 smithi106 bash[13484]: cluster 2021-01-27T16:40:11.395741+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:13.076 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2021-01-27T16:40:13.077 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBtlxFgbzAnBBAA2yj+0X+c1gtl7gVy7wNAhA== 2021-01-27T16:40:13.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:13 smithi094 bash[9811]: audit 2021-01-27T16:40:11.556874+0000 mgr.y (mgr.14138) 329 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:13.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:13 smithi094 bash[9811]: audit 2021-01-27T16:40:13.069202+0000 mon.a (mon.0) 593 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:13.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:13 smithi094 bash[9811]: audit 2021-01-27T16:40:13.076330+0000 mon.a (mon.0) 594 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:13.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[9795]: audit 2021-01-27T16:40:11.556874+0000 mgr.y (mgr.14138) 329 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[9795]: audit 2021-01-27T16:40:13.069202+0000 mon.a (mon.0) 593 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[9795]: audit 2021-01-27T16:40:13.076330+0000 mon.a (mon.0) 594 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:13.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[13484]: audit 2021-01-27T16:40:11.556874+0000 mgr.y (mgr.14138) 329 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:13.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[13484]: audit 2021-01-27T16:40:13.069202+0000 mon.a (mon.0) 593 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:13.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:13 smithi106 bash[13484]: audit 2021-01-27T16:40:13.076330+0000 mon.a (mon.0) 594 : audit [INF] from='client.? 172.21.15.106:0/4204559808' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:14.319 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:40:14.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-01-27T16:40:14.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-27T16:40:14.338 DEBUG:teuthology.orchestra.run.smithi094:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-27T16:40:14.626 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:14 smithi106 bash[9795]: cluster 2021-01-27T16:40:13.396869+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:14.626 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:14 smithi106 bash[13484]: cluster 2021-01-27T16:40:13.396869+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:14.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:14 smithi094 bash[9811]: cluster 2021-01-27T16:40:13.396869+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:16.785 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:16 smithi094 bash[9811]: cluster 2021-01-27T16:40:15.397967+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:16.817 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:16 smithi106 bash[9795]: cluster 2021-01-27T16:40:15.397967+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:16.818 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:16 smithi106 bash[13484]: cluster 2021-01-27T16:40:15.397967+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:17.953 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:17 smithi106 systemd[1]: Started Ceph alertmanager.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:17 smithi094 bash[9811]: cluster 2021-01-27T16:40:17.399069+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:17 smithi094 bash[9811]: audit 2021-01-27T16:40:17.936394+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:17 smithi094 bash[9811]: audit 2021-01-27T16:40:17.938538+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:18.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:17 smithi094 bash[9811]: audit 2021-01-27T16:40:17.938849+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:18.365 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2021-01-27T16:40:18.366 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBylxFggpuJFRAAhfa6NJF2HHkFliWj2CBlVQ== 2021-01-27T16:40:18.395 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[13484]: cluster 2021-01-27T16:40:17.399069+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:18.395 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[13484]: audit 2021-01-27T16:40:17.936394+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:18.396 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[13484]: audit 2021-01-27T16:40:17.938538+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:18.396 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[13484]: audit 2021-01-27T16:40:17.938849+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:18.396 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[9795]: cluster 2021-01-27T16:40:17.399069+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:18.397 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[9795]: audit 2021-01-27T16:40:17.936394+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:18.397 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[9795]: audit 2021-01-27T16:40:17.938538+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:18.398 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:17 smithi106 bash[9795]: audit 2021-01-27T16:40:17.938849+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:19.246 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:18 smithi094 bash[9811]: audit 2021-01-27T16:40:18.361052+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.247 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:18 smithi094 bash[9811]: audit 2021-01-27T16:40:18.361925+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.94:0/843115086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.247 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:18 smithi094 bash[9811]: audit 2021-01-27T16:40:18.365356+0000 mon.a (mon.0) 599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:19.248 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2021-01-27T16:40:19.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-01-27T16:40:19.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-27T16:40:19.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T16:40:19.280 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[13484]: audit 2021-01-27T16:40:18.361052+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.280 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[13484]: audit 2021-01-27T16:40:18.361925+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.94:0/843115086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.280 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[13484]: audit 2021-01-27T16:40:18.365356+0000 mon.a (mon.0) 599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:19.281 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[9795]: audit 2021-01-27T16:40:18.361052+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.281 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[9795]: audit 2021-01-27T16:40:18.361925+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.94:0/843115086' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-27T16:40:19.281 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:18 smithi106 bash[9795]: audit 2021-01-27T16:40:18.365356+0000 mon.a (mon.0) 599 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-27T16:40:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:19.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.345Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T16:40:19.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.345Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T16:40:19.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.347Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.106 port=9094 2021-01-27T16:40:19.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.350Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T16:40:19.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.383Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T16:40:19.705 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.384Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T16:40:19.705 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:19.389Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T16:40:20.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:19 smithi094 bash[9811]: cluster 2021-01-27T16:40:19.399943+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:20.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:19 smithi094 bash[9811]: audit 2021-01-27T16:40:19.605880+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:20.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:19 smithi094 bash[9811]: audit 2021-01-27T16:40:19.736376+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:20.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[9795]: cluster 2021-01-27T16:40:19.399943+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:20.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[9795]: audit 2021-01-27T16:40:19.605880+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:20.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[9795]: audit 2021-01-27T16:40:19.736376+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:20.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[13484]: cluster 2021-01-27T16:40:19.399943+0000 mgr.y (mgr.14138) 333 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:20.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[13484]: audit 2021-01-27T16:40:19.605880+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:20.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:19 smithi106 bash[13484]: audit 2021-01-27T16:40:19.736376+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.351 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:19.737884+0000 mgr.y (mgr.14138) 334 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:40:21.352 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.167560+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.352 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.169353+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:21.352 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.170733+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:21.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.171672+0000 mgr.y (mgr.14138) 337 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:21.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.172526+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.173387+0000 mgr.y (mgr.14138) 339 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:21.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.174250+0000 mgr.y (mgr.14138) 340 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.353 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.175138+0000 mgr.y (mgr.14138) 341 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:40:21.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.282395+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.287662+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.288528+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.289439+0000 mgr.y (mgr.14138) 342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.354 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: audit 2021-01-27T16:40:20.295453+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.355 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[9795]: cephadm 2021-01-27T16:40:20.301395+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Deploying daemon grafana.a on smithi094 2021-01-27T16:40:21.355 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:19.737884+0000 mgr.y (mgr.14138) 334 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:40:21.355 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.167560+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.355 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.169353+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:21.356 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.170733+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:21.356 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.171672+0000 mgr.y (mgr.14138) 337 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:21.356 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.172526+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.356 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.173387+0000 mgr.y (mgr.14138) 339 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:21.356 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.174250+0000 mgr.y (mgr.14138) 340 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.357 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.175138+0000 mgr.y (mgr.14138) 341 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:40:21.357 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.282395+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.357 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.287662+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.357 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.288528+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.357 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.289439+0000 mgr.y (mgr.14138) 342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.358 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: audit 2021-01-27T16:40:20.295453+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.358 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[13484]: cephadm 2021-01-27T16:40:20.301395+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Deploying daemon grafana.a on smithi094 2021-01-27T16:40:21.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:19.737884+0000 mgr.y (mgr.14138) 334 : cephadm [INF] refreshing smithi094 facts 2021-01-27T16:40:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.167560+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.169353+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.170733+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.171672+0000 mgr.y (mgr.14138) 337 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:21.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.172526+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.173387+0000 mgr.y (mgr.14138) 339 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:21.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.174250+0000 mgr.y (mgr.14138) 340 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:21.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.175138+0000 mgr.y (mgr.14138) 341 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi094', network='', name='a')] 2021-01-27T16:40:21.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.282395+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.539 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.287662+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.539 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.288528+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.539 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.289439+0000 mgr.y (mgr.14138) 342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-27T16:40:21.539 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: audit 2021-01-27T16:40:20.295453+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:21.540 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[9811]: cephadm 2021-01-27T16:40:20.301395+0000 mgr.y (mgr.14138) 343 : cephadm [INF] Deploying daemon grafana.a on smithi094 2021-01-27T16:40:21.635 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[10032]: debug 2021-01-27T16:40:21.562+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:21.636 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:21 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:21.351Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000204523s 2021-01-27T16:40:22.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:22.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:22 smithi106 bash[9795]: cluster 2021-01-27T16:40:21.401132+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:22.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:22 smithi106 bash[13484]: cluster 2021-01-27T16:40:21.401132+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:22.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:22 smithi094 bash[9811]: cluster 2021-01-27T16:40:21.401132+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:23.077 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:40:23.078 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":59,"fsid":"294bdd66-60bd-11eb-8f9a-001a4aab830c","created":"2021-01-27T16:32:29.045691+0000","modified":"2021-01-27T16:39:32.322792+0000","last_up_change":"2021-01-27T16:39:07.566656+0000","last_in_change":"2021-01-27T16:39:07.566656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T16:34:20.360029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T16:39:03.472231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T16:39:23.212926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T16:39:23.719884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T16:39:25.726193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T16:39:28.758474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"602f7089-9ced-4651-aec4-152bc61f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6803","nonce":2604730968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6805","nonce":2604730968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6809","nonce":2604730968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6807","nonce":2604730968}]},"public_addr":"172.21.15.106:6803/2604730968","cluster_addr":"172.21.15.106:6805/2604730968","heartbeat_back_addr":"172.21.15.106:6809/2604730968","heartbeat_front_addr":"172.21.15.106:6807/2604730968","state":["exists","up"]},{"osd":1,"uuid":"49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6811","nonce":3792678646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6813","nonce":3792678646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6817","nonce":3792678646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6815","nonce":3792678646}]},"public_addr":"172.21.15.106:6811/3792678646","cluster_addr":"172.21.15.106:6813/3792678646","heartbeat_back_addr":"172.21.15.106:6817/3792678646","heartbeat_front_addr":"172.21.15.106:6815/3792678646","state":["exists","up"]},{"osd":2,"uuid":"e3312df2-156f-4ecf-81b4-7b5cc0fabd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6819","nonce":2900657738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6821","nonce":2900657738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6825","nonce":2900657738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6823","nonce":2900657738}]},"public_addr":"172.21.15.106:6819/2900657738","cluster_addr":"172.21.15.106:6821/2900657738","heartbeat_back_addr":"172.21.15.106:6825/2900657738","heartbeat_front_addr":"172.21.15.106:6823/2900657738","state":["exists","up"]},{"osd":3,"uuid":"3482f065-fb56-419b-9661-976fe0fe2a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6827","nonce":2657826375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6829","nonce":2657826375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6833","nonce":2657826375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6831","nonce":2657826375}]},"public_addr":"172.21.15.106:6827/2657826375","cluster_addr":"172.21.15.106:6829/2657826375","heartbeat_back_addr":"172.21.15.106:6833/2657826375","heartbeat_front_addr":"172.21.15.106:6831/2657826375","state":["exists","up"]},{"osd":4,"uuid":"bace9ab3-237b-4ed3-a0b8-fae82cac33b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6801","nonce":4275584131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6803","nonce":4275584131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6807","nonce":4275584131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6805","nonce":4275584131}]},"public_addr":"172.21.15.94:6801/4275584131","cluster_addr":"172.21.15.94:6803/4275584131","heartbeat_back_addr":"172.21.15.94:6807/4275584131","heartbeat_front_addr":"172.21.15.94:6805/4275584131","state":["exists","up"]},{"osd":5,"uuid":"53460a4a-1c49-4f75-961a-c6e08e18fbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6809","nonce":624844330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6811","nonce":624844330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6815","nonce":624844330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6813","nonce":624844330}]},"public_addr":"172.21.15.94:6809/624844330","cluster_addr":"172.21.15.94:6811/624844330","heartbeat_back_addr":"172.21.15.94:6815/624844330","heartbeat_front_addr":"172.21.15.94:6813/624844330","state":["exists","up"]},{"osd":6,"uuid":"0133a60f-9d9e-4173-a081-8967e48630ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6817","nonce":1928175091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6819","nonce":1928175091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6823","nonce":1928175091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6821","nonce":1928175091}]},"public_addr":"172.21.15.94:6817/1928175091","cluster_addr":"172.21.15.94:6819/1928175091","heartbeat_back_addr":"172.21.15.94:6823/1928175091","heartbeat_front_addr":"172.21.15.94:6821/1928175091","state":["exists","up"]},{"osd":7,"uuid":"3ee57c5f-098b-4032-8cd6-265cd1c5c34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6825","nonce":974148326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6827","nonce":974148326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6831","nonce":974148326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6829","nonce":974148326}]},"public_addr":"172.21.15.94:6825/974148326","cluster_addr":"172.21.15.94:6827/974148326","heartbeat_back_addr":"172.21.15.94:6831/974148326","heartbeat_front_addr":"172.21.15.94:6829/974148326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:35:39.387958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:08.089459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:36.683542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:03.637665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:32.024392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:04.188215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:34.521324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:39:05.986637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:0/1539490405":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/1613508695":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/2883723824":"2021-01-28T16:33:03.753341+0000","172.21.15.106:0/1720539314":"2021-01-28T16:33:03.753341+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T16:40:23.453 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:23 smithi106 bash[9795]: audit 2021-01-27T16:40:21.565308+0000 mgr.y (mgr.14138) 345 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:23.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:23 smithi106 bash[9795]: audit 2021-01-27T16:40:23.074762+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/1456351843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:40:23.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:23 smithi106 bash[13484]: audit 2021-01-27T16:40:21.565308+0000 mgr.y (mgr.14138) 345 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:23.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:23 smithi106 bash[13484]: audit 2021-01-27T16:40:23.074762+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/1456351843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:40:23.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:23 smithi094 bash[9811]: audit 2021-01-27T16:40:21.565308+0000 mgr.y (mgr.14138) 345 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:23.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:23 smithi094 bash[9811]: audit 2021-01-27T16:40:23.074762+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.106:0/1456351843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:40:23.861 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-27T16:34:20.360029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-01-27T16:39:03.472231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-01-27T16:39:23.212926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.log', 'create_time': '2021-01-27T16:39:23.719884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.control', 'create_time': '2021-01-27T16:39:25.726193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'zone.rgw.meta', 'create_time': '2021-01-27T16:39:28.758474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-01-27T16:40:23.862 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-01-27T16:40:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:24.190 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:24 smithi106 bash[13484]: cluster 2021-01-27T16:40:23.402412+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:24.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:24 smithi106 bash[9795]: cluster 2021-01-27T16:40:23.402412+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:24 smithi094 bash[9811]: cluster 2021-01-27T16:40:23.402412+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:25.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[13484]: audit 2021-01-27T16:40:25.310061+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-27T16:40:25.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[13484]: audit 2021-01-27T16:40:25.310842+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-01-27T16:40:25.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[13484]: audit 2021-01-27T16:40:25.311399+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-27T16:40:25.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[13484]: audit 2021-01-27T16:40:25.311900+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-01-27T16:40:25.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[9795]: audit 2021-01-27T16:40:25.310061+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-27T16:40:25.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[9795]: audit 2021-01-27T16:40:25.310842+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-01-27T16:40:25.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[9795]: audit 2021-01-27T16:40:25.311399+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-27T16:40:25.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:25 smithi106 bash[9795]: audit 2021-01-27T16:40:25.311900+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-01-27T16:40:25.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:25 smithi094 bash[9811]: audit 2021-01-27T16:40:25.310061+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-27T16:40:25.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:25 smithi094 bash[9811]: audit 2021-01-27T16:40:25.310842+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-01-27T16:40:25.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:25 smithi094 bash[9811]: audit 2021-01-27T16:40:25.311399+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-27T16:40:25.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:25 smithi094 bash[9811]: audit 2021-01-27T16:40:25.311900+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-01-27T16:40:26.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.368972+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-27T16:40:26.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.369153+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2021-01-27T16:40:26.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.369243+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-27T16:40:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.369434+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-01-27T16:40:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: cluster 2021-01-27T16:40:25.369601+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T16:40:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: cluster 2021-01-27T16:40:25.403097+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:40:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.731951+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:40:26.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: audit 2021-01-27T16:40:25.735081+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:40:26.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[9795]: cluster 2021-01-27T16:40:26.370816+0000 mon.a (mon.0) 618 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T16:40:26.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.368972+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-27T16:40:26.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.369153+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2021-01-27T16:40:26.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.369243+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-27T16:40:26.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.369434+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-01-27T16:40:26.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: cluster 2021-01-27T16:40:25.369601+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T16:40:26.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: cluster 2021-01-27T16:40:25.403097+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:40:26.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.731951+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:40:26.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: audit 2021-01-27T16:40:25.735081+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:40:26.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:26 smithi106 bash[13484]: cluster 2021-01-27T16:40:26.370816+0000 mon.a (mon.0) 618 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T16:40:26.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.368972+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-27T16:40:26.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.369153+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]': finished 2021-01-27T16:40:26.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.369243+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-27T16:40:26.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.369434+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]': finished 2021-01-27T16:40:26.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: cluster 2021-01-27T16:40:25.369601+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-27T16:40:26.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: cluster 2021-01-27T16:40:25.403097+0000 mgr.y (mgr.14138) 347 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:40:26.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.731951+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:40:26.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: audit 2021-01-27T16:40:25.735081+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:40:26.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:26 smithi094 bash[9811]: cluster 2021-01-27T16:40:26.370816+0000 mon.a (mon.0) 618 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-27T16:40:27.624 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2021-01-27T16:40:28.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:27 smithi106 bash[9795]: cluster 2021-01-27T16:40:27.404107+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v262: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 38 B/s, 0 objects/s recovering 2021-01-27T16:40:28.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:27 smithi106 bash[9795]: audit 2021-01-27T16:40:27.624059+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.106:0/2683141589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T16:40:28.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:27 smithi106 bash[13484]: cluster 2021-01-27T16:40:27.404107+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v262: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 38 B/s, 0 objects/s recovering 2021-01-27T16:40:28.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:27 smithi106 bash[13484]: audit 2021-01-27T16:40:27.624059+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.106:0/2683141589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T16:40:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:27 smithi094 bash[9811]: cluster 2021-01-27T16:40:27.404107+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v262: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 38 B/s, 0 objects/s recovering 2021-01-27T16:40:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:27 smithi094 bash[9811]: audit 2021-01-27T16:40:27.624059+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.106:0/2683141589' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-27T16:40:28.391 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-01-27T16:40:28.549 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:29.703 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:29 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:29.351Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000903645s 2021-01-27T16:40:30.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:30 smithi094 bash[9811]: cluster 2021-01-27T16:40:29.405217+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v263: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 131 B/s, 1 objects/s recovering 2021-01-27T16:40:30.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:30 smithi106 bash[9795]: cluster 2021-01-27T16:40:29.405217+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v263: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 131 B/s, 1 objects/s recovering 2021-01-27T16:40:30.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:30 smithi106 bash[13484]: cluster 2021-01-27T16:40:29.405217+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v263: 132 pgs: 1 peering, 1 active+recovering, 130 active+clean; 24 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 7/936 objects misplaced (0.748%); 131 B/s, 1 objects/s recovering 2021-01-27T16:40:31.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:31 smithi106 bash[10032]: debug 2021-01-27T16:40:31.562+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:32.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:32.060 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2021-01-27T16:40:32.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:32 smithi106 bash[9795]: cluster 2021-01-27T16:40:31.406180+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v264: 132 pgs: 1 active+recovering, 131 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 7/975 objects misplaced (0.718%); 256 B/s, 3 objects/s recovering 2021-01-27T16:40:32.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:32 smithi106 bash[9795]: audit 2021-01-27T16:40:32.060044+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.106:0/3260627434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T16:40:32.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:32 smithi106 bash[13484]: cluster 2021-01-27T16:40:31.406180+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v264: 132 pgs: 1 active+recovering, 131 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 7/975 objects misplaced (0.718%); 256 B/s, 3 objects/s recovering 2021-01-27T16:40:32.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:32 smithi106 bash[13484]: audit 2021-01-27T16:40:32.060044+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.106:0/3260627434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T16:40:32.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:32 smithi094 bash[9811]: cluster 2021-01-27T16:40:31.406180+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v264: 132 pgs: 1 active+recovering, 131 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 7/975 objects misplaced (0.718%); 256 B/s, 3 objects/s recovering 2021-01-27T16:40:33.210 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:32 smithi094 bash[9811]: audit 2021-01-27T16:40:32.060044+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.106:0/3260627434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-27T16:40:33.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-01-27T16:40:33.382 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:33 smithi106 bash[9795]: audit 2021-01-27T16:40:31.566693+0000 mgr.y (mgr.14138) 351 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:33.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:33 smithi106 bash[13484]: audit 2021-01-27T16:40:31.566693+0000 mgr.y (mgr.14138) 351 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:33.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:33 smithi094 bash[9811]: audit 2021-01-27T16:40:31.566693+0000 mgr.y (mgr.14138) 351 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:34 smithi106 bash[13484]: cluster 2021-01-27T16:40:33.406973+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s; 321 B/s, 3 objects/s recovering 2021-01-27T16:40:34.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:34 smithi106 bash[9795]: cluster 2021-01-27T16:40:33.406973+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s; 321 B/s, 3 objects/s recovering 2021-01-27T16:40:34.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:34 smithi094 bash[9811]: cluster 2021-01-27T16:40:33.406973+0000 mgr.y (mgr.14138) 352 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 0 op/s; 321 B/s, 3 objects/s recovering 2021-01-27T16:40:35.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:35 smithi094 bash[9811]: cluster 2021-01-27T16:40:35.408062+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 258 B/s, 3 objects/s recovering 2021-01-27T16:40:35.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:35 smithi106 bash[9795]: cluster 2021-01-27T16:40:35.408062+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 258 B/s, 3 objects/s recovering 2021-01-27T16:40:35.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:35 smithi106 bash[13484]: cluster 2021-01-27T16:40:35.408062+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s; 258 B/s, 3 objects/s recovering 2021-01-27T16:40:36.728 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 3 2021-01-27T16:40:37.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:36 smithi094 bash[9811]: audit 2021-01-27T16:40:36.727170+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.106:0/4070760808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T16:40:37.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:36 smithi106 bash[9795]: audit 2021-01-27T16:40:36.727170+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.106:0/4070760808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T16:40:37.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:36 smithi106 bash[13484]: audit 2021-01-27T16:40:36.727170+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.106:0/4070760808' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-27T16:40:37.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2021-01-27T16:40:37.636 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:37.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[13484]: audit 2021-01-27T16:40:36.924980+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:37.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[13484]: audit 2021-01-27T16:40:36.928404+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:37.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[13484]: audit 2021-01-27T16:40:36.929052+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:37.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[13484]: cluster 2021-01-27T16:40:37.409501+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 649 B/s wr, 8 op/s; 233 B/s, 2 objects/s recovering 2021-01-27T16:40:37.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[9795]: audit 2021-01-27T16:40:36.924980+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:37.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[9795]: audit 2021-01-27T16:40:36.928404+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:37.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[9795]: audit 2021-01-27T16:40:36.929052+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:37.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:37 smithi106 bash[9795]: cluster 2021-01-27T16:40:37.409501+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 649 B/s wr, 8 op/s; 233 B/s, 2 objects/s recovering 2021-01-27T16:40:38.226 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:37 smithi094 bash[9811]: audit 2021-01-27T16:40:36.924980+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:38.227 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:37 smithi094 bash[9811]: audit 2021-01-27T16:40:36.928404+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:38.227 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:37 smithi094 bash[9811]: audit 2021-01-27T16:40:36.929052+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:38.227 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:37 smithi094 bash[9811]: cluster 2021-01-27T16:40:37.409501+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 649 B/s wr, 8 op/s; 233 B/s, 2 objects/s recovering 2021-01-27T16:40:38.494 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-01-27T16:40:38.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-01-27T16:40:38.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-01-27T16:40:38.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-01-27T16:40:38.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-01-27T16:40:39.081 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-01-27T16:40:39.082 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-01-27T16:40:39.082 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:38 smithi094 bash[24555]: t=2021-01-27T16:40:38+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T16:40:39.082 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-01-27T16:40:39.392 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-01-27T16:40:39.392 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-01-27T16:40:39.392 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-01-27T16:40:39.393 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-01-27T16:40:39.393 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-01-27T16:40:39.643 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-01-27T16:40:39.644 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-01-27T16:40:39.644 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-01-27T16:40:39.644 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-01-27T16:40:39.644 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: audit 2021-01-27T16:40:38.584328+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:38.586440+0000 mgr.y (mgr.14138) 355 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:40:39.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: audit 2021-01-27T16:40:38.995948+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: audit 2021-01-27T16:40:39.007981+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.645 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.009027+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:39.646 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.009852+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:39.646 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.010673+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:39.646 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.011190+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.646 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.011763+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:39.647 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.012331+0000 mgr.y (mgr.14138) 361 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.647 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.012871+0000 mgr.y (mgr.14138) 362 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.647 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.014445+0000 mgr.y (mgr.14138) 363 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T16:40:39.647 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cephadm 2021-01-27T16:40:39.017600+0000 mgr.y (mgr.14138) 364 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi106 2021-01-27T16:40:39.647 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[9811]: cluster 2021-01-27T16:40:39.410462+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s; 189 B/s, 2 objects/s recovering 2021-01-27T16:40:39.869 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: audit 2021-01-27T16:40:38.584328+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.870 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:38.586440+0000 mgr.y (mgr.14138) 355 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:40:39.870 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: audit 2021-01-27T16:40:38.995948+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.870 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: audit 2021-01-27T16:40:39.007981+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.870 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.009027+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:39.870 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.009852+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:39.871 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.010673+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:39.871 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.011190+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.871 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.011763+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:39.871 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.012331+0000 mgr.y (mgr.14138) 361 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.872 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.012871+0000 mgr.y (mgr.14138) 362 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.872 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.014445+0000 mgr.y (mgr.14138) 363 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T16:40:39.872 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cephadm 2021-01-27T16:40:39.017600+0000 mgr.y (mgr.14138) 364 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi106 2021-01-27T16:40:39.872 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[13484]: cluster 2021-01-27T16:40:39.410462+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s; 189 B/s, 2 objects/s recovering 2021-01-27T16:40:39.873 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: audit 2021-01-27T16:40:38.584328+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.873 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:38.586440+0000 mgr.y (mgr.14138) 355 : cephadm [INF] refreshing smithi106 facts 2021-01-27T16:40:39.873 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: audit 2021-01-27T16:40:38.995948+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.873 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: audit 2021-01-27T16:40:39.007981+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:39.874 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.009027+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:40:39.874 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.009852+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:40:39.874 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.010673+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:40:39.874 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.011190+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.875 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.011763+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:40:39.875 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.012331+0000 mgr.y (mgr.14138) 361 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.875 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.012871+0000 mgr.y (mgr.14138) 362 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:40:39.875 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.014445+0000 mgr.y (mgr.14138) 363 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-27T16:40:39.875 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cephadm 2021-01-27T16:40:39.017600+0000 mgr.y (mgr.14138) 364 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi106 2021-01-27T16:40:39.876 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:39 smithi106 bash[9795]: cluster 2021-01-27T16:40:39.410462+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 597 B/s wr, 7 op/s; 189 B/s, 2 objects/s recovering 2021-01-27T16:40:39.936 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-01-27T16:40:39.937 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-01-27T16:40:39.937 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-01-27T16:40:39.937 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-01-27T16:40:40.272 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:39 smithi094 bash[24555]: t=2021-01-27T16:40:39+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-01-27T16:40:40.272 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-01-27T16:40:40.272 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-01-27T16:40:40.273 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-01-27T16:40:40.535 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-01-27T16:40:40.535 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-01-27T16:40:40.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-01-27T16:40:40.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-01-27T16:40:40.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-01-27T16:40:40.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-01-27T16:40:40.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-01-27T16:40:40.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-01-27T16:40:41.101 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-01-27T16:40:41.101 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-01-27T16:40:41.102 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:40 smithi094 bash[24555]: t=2021-01-27T16:40:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-01-27T16:40:41.102 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-01-27T16:40:41.403 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-01-27T16:40:41.403 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-01-27T16:40:41.403 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-01-27T16:40:41.403 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-01-27T16:40:41.654 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:41.655 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-01-27T16:40:41.655 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-01-27T16:40:41.655 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-01-27T16:40:41.775 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2021-01-27T16:40:41.832 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:41 smithi106 bash[10032]: debug 2021-01-27T16:40:41.573+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:41.914 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-01-27T16:40:41.914 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-01-27T16:40:41.915 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-01-27T16:40:41.915 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-01-27T16:40:41.915 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-01-27T16:40:42.165 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:41 smithi094 bash[24555]: t=2021-01-27T16:40:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-01-27T16:40:42.165 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-01-27T16:40:42.450 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-01-27T16:40:42.450 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-01-27T16:40:42.450 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-01-27T16:40:42.451 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-01-27T16:40:42.682 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:42 smithi106 bash[9795]: cluster 2021-01-27T16:40:41.411561+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s; 127 B/s, 1 objects/s recovering 2021-01-27T16:40:42.683 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:42 smithi106 bash[9795]: audit 2021-01-27T16:40:41.774589+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.106:0/131680436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T16:40:42.683 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:42 smithi106 bash[13484]: cluster 2021-01-27T16:40:41.411561+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s; 127 B/s, 1 objects/s recovering 2021-01-27T16:40:42.684 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:42 smithi106 bash[13484]: audit 2021-01-27T16:40:41.774589+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.106:0/131680436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T16:40:42.735 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[9811]: cluster 2021-01-27T16:40:41.411561+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s; 127 B/s, 1 objects/s recovering 2021-01-27T16:40:42.735 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[9811]: audit 2021-01-27T16:40:41.774589+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.106:0/131680436' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-27T16:40:42.735 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-01-27T16:40:42.736 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-01-27T16:40:42.736 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-01-27T16:40:42.736 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-01-27T16:40:42.736 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-01-27T16:40:43.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-01-27T16:40:43.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-01-27T16:40:43.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:42 smithi094 bash[24555]: t=2021-01-27T16:40:42+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-01-27T16:40:43.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2021-01-27T16:40:43.324 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:43.361 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-01-27T16:40:43.361 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-01-27T16:40:43.361 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-01-27T16:40:43.362 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-01-27T16:40:43.664 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[9811]: audit 2021-01-27T16:40:41.576874+0000 mgr.y (mgr.14138) 367 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:43.664 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-01-27T16:40:43.665 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-01-27T16:40:43.665 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-01-27T16:40:43.665 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-01-27T16:40:43.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:43 smithi106 bash[9795]: audit 2021-01-27T16:40:41.576874+0000 mgr.y (mgr.14138) 367 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:43.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:43 smithi106 bash[13484]: audit 2021-01-27T16:40:41.576874+0000 mgr.y (mgr.14138) 367 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:43.984 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-01-27T16:40:43.984 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-01-27T16:40:43.984 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-01-27T16:40:43.984 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-01-27T16:40:44.276 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:43 smithi094 bash[24555]: t=2021-01-27T16:40:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-01-27T16:40:44.276 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-01-27T16:40:44.277 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-27T16:40:44.277 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-01-27T16:40:44.277 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-01-27T16:40:44.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[9811]: cluster 2021-01-27T16:40:43.412618+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T16:40:44.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-01-27T16:40:44.537 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-01-27T16:40:44.537 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-01-27T16:40:44.766 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:44 smithi106 bash[9795]: cluster 2021-01-27T16:40:43.412618+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T16:40:44.767 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:44 smithi106 bash[13484]: cluster 2021-01-27T16:40:43.412618+0000 mgr.y (mgr.14138) 368 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 44 B/s, 0 objects/s recovering 2021-01-27T16:40:44.812 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-01-27T16:40:44.813 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-01-27T16:40:44.813 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-01-27T16:40:45.080 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-01-27T16:40:45.080 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:44 smithi094 bash[24555]: t=2021-01-27T16:40:44+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-01-27T16:40:45.081 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-01-27T16:40:45.339 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-01-27T16:40:45.340 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-01-27T16:40:45.340 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-01-27T16:40:45.599 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[9811]: cluster 2021-01-27T16:40:45.413633+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:45.599 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-01-27T16:40:45.600 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-01-27T16:40:45.600 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-01-27T16:40:45.742 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:45 smithi106 bash[9795]: cluster 2021-01-27T16:40:45.413633+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:45.743 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:45 smithi106 bash[13484]: cluster 2021-01-27T16:40:45.413633+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:45.917 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-01-27T16:40:45.917 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-01-27T16:40:45.918 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-01-27T16:40:45.918 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-01-27T16:40:45.918 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-01-27T16:40:46.260 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:45 smithi094 bash[24555]: t=2021-01-27T16:40:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-01-27T16:40:46.260 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-01-27T16:40:46.261 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-01-27T16:40:46.511 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-01-27T16:40:46.512 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-01-27T16:40:46.512 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-01-27T16:40:46.736 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:46 smithi106 systemd[1]: Stopping Ceph alertmanager.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c... 2021-01-27T16:40:46.736 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:46 smithi106 bash[26658]: level=info ts=2021-01-27T16:40:46.649Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T16:40:46.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-01-27T16:40:46.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-01-27T16:40:46.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-01-27T16:40:46.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-01-27T16:40:47.139 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-01-27T16:40:47.140 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-01-27T16:40:47.140 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:46 smithi094 bash[24555]: t=2021-01-27T16:40:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-01-27T16:40:47.140 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-01-27T16:40:47.141 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-01-27T16:40:47.433 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-01-27T16:40:47.433 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-01-27T16:40:47.433 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-01-27T16:40:47.768 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-01-27T16:40:47.768 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-01-27T16:40:47.768 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-01-27T16:40:47.769 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-01-27T16:40:47.769 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-01-27T16:40:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[9811]: cluster 2021-01-27T16:40:47.415073+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:48.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-01-27T16:40:48.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:47 smithi094 bash[24555]: t=2021-01-27T16:40:47+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-01-27T16:40:48.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-01-27T16:40:48.281 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:47 smithi106 bash[9795]: cluster 2021-01-27T16:40:47.415073+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:48.281 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:47 smithi106 bash[13484]: cluster 2021-01-27T16:40:47.415073+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:48.281 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:48 smithi106 docker[28257]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c-alertmanager.a 2021-01-27T16:40:48.379 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-01-27T16:40:48.380 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-01-27T16:40:48.380 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-01-27T16:40:48.380 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-01-27T16:40:48.673 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-01-27T16:40:48.673 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-01-27T16:40:48.673 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-01-27T16:40:48.673 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-01-27T16:40:48.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:48 smithi106 systemd[1]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@alertmanager.a.service: Succeeded. 2021-01-27T16:40:48.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:48 smithi106 systemd[1]: Stopped Ceph alertmanager.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:48.704 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:48 smithi106 systemd[1]: Started Ceph alertmanager.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:49.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-01-27T16:40:49.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:48 smithi094 bash[24555]: t=2021-01-27T16:40:48+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-01-27T16:40:49.191 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2021-01-27T16:40:49.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[24555]: t=2021-01-27T16:40:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-01-27T16:40:49.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[9811]: audit 2021-01-27T16:40:48.318102+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:49.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[9811]: cephadm 2021-01-27T16:40:48.320784+0000 mgr.y (mgr.14138) 371 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T16:40:49.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[9811]: cephadm 2021-01-27T16:40:48.326364+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi094 2021-01-27T16:40:49.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[9811]: audit 2021-01-27T16:40:49.190583+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.106:0/4218340704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T16:40:49.640 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[9795]: audit 2021-01-27T16:40:48.318102+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:49.640 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[9795]: cephadm 2021-01-27T16:40:48.320784+0000 mgr.y (mgr.14138) 371 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T16:40:49.641 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[9795]: cephadm 2021-01-27T16:40:48.326364+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi094 2021-01-27T16:40:49.641 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[9795]: audit 2021-01-27T16:40:49.190583+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.106:0/4218340704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T16:40:49.641 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[13484]: audit 2021-01-27T16:40:48.318102+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:49.641 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[13484]: cephadm 2021-01-27T16:40:48.320784+0000 mgr.y (mgr.14138) 371 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-27T16:40:49.642 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[13484]: cephadm 2021-01-27T16:40:48.326364+0000 mgr.y (mgr.14138) 372 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi094 2021-01-27T16:40:49.642 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:49 smithi106 bash[13484]: audit 2021-01-27T16:40:49.190583+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.106:0/4218340704' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-27T16:40:50.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[24555]: t=2021-01-27T16:40:49+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-01-27T16:40:50.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:49 smithi094 bash[24555]: t=2021-01-27T16:40:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-01-27T16:40:50.450 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2021-01-27T16:40:50.530 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:50 smithi094 bash[9811]: cluster 2021-01-27T16:40:49.416198+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:50.530 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:50 smithi094 bash[24555]: t=2021-01-27T16:40:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-01-27T16:40:50.590 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[13484]: cluster 2021-01-27T16:40:49.416198+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:50.590 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[9795]: cluster 2021-01-27T16:40:49.416198+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:50.623 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:50.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:50 smithi094 bash[24555]: t=2021-01-27T16:40:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-01-27T16:40:50.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:50 smithi094 bash[24555]: t=2021-01-27T16:40:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-01-27T16:40:50.954 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.588Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-27T16:40:50.954 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.588Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-27T16:40:50.955 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.591Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.106 port=9094 2021-01-27T16:40:50.955 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.592Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-27T16:40:50.955 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.628Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T16:40:50.955 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.628Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-27T16:40:50.956 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:50 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:50.631Z caller=main.go:497 msg=Listening address=:9093 2021-01-27T16:40:51.179 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:50 smithi094 bash[24555]: t=2021-01-27T16:40:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-01-27T16:40:51.180 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-01-27T16:40:51.489 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-01-27T16:40:51.490 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-01-27T16:40:51.490 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-01-27T16:40:51.786 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:40:51.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-01-27T16:40:51.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:51 smithi094 bash[24555]: t=2021-01-27T16:40:51+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-01-27T16:40:51.855 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:40:51 smithi106 bash[10032]: debug 2021-01-27T16:40:51.581+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:40:52.632 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[9811]: cluster 2021-01-27T16:40:51.417314+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:52.633 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[24555]: t=2021-01-27T16:40:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-01-27T16:40:52.633 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[24555]: t=2021-01-27T16:40:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-01-27T16:40:52.726 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:52 smithi106 bash[9795]: cluster 2021-01-27T16:40:51.417314+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:52.726 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:40:52 smithi106 bash[28316]: level=info ts=2021-01-27T16:40:52.592Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000095291s 2021-01-27T16:40:52.726 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:52 smithi106 bash[13484]: cluster 2021-01-27T16:40:51.417314+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:53.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[24555]: t=2021-01-27T16:40:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-01-27T16:40:53.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[24555]: t=2021-01-27T16:40:52+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-01-27T16:40:53.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:52 smithi094 bash[24555]: t=2021-01-27T16:40:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-01-27T16:40:53.659 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:53 smithi094 bash[9811]: audit 2021-01-27T16:40:51.585103+0000 mgr.y (mgr.14138) 375 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:53.659 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:53 smithi094 bash[9811]: cluster 2021-01-27T16:40:53.418497+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:53.660 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:53 smithi094 bash[24555]: t=2021-01-27T16:40:53+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-01-27T16:40:53.660 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:53 smithi094 bash[24555]: t=2021-01-27T16:40:53+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-01-27T16:40:53.811 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:53 smithi106 bash[9795]: audit 2021-01-27T16:40:51.585103+0000 mgr.y (mgr.14138) 375 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:53.811 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:53 smithi106 bash[9795]: cluster 2021-01-27T16:40:53.418497+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:53.811 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:53 smithi106 bash[13484]: audit 2021-01-27T16:40:51.585103+0000 mgr.y (mgr.14138) 375 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:40:53.811 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:53 smithi106 bash[13484]: cluster 2021-01-27T16:40:53.418497+0000 mgr.y (mgr.14138) 376 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:54.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:53 smithi094 bash[24555]: t=2021-01-27T16:40:53+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-01-27T16:40:54.217 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2021-01-27T16:40:54.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[9811]: audit 2021-01-27T16:40:54.216324+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3511090648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T16:40:54.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-01-27T16:40:54.537 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-01-27T16:40:54.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:54 smithi106 bash[9795]: audit 2021-01-27T16:40:54.216324+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3511090648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T16:40:54.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:54 smithi106 bash[13484]: audit 2021-01-27T16:40:54.216324+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.106:0/3511090648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-27T16:40:54.854 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-01-27T16:40:54.854 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-01-27T16:40:55.059 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-27T16:40:55.060 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-01-27T16:40:55.060 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph mgr dump --format=json 2021-01-27T16:40:55.197 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-01-27T16:40:55.198 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:54 smithi094 bash[24555]: t=2021-01-27T16:40:54+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-01-27T16:40:55.198 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:55 smithi094 bash[24555]: t=2021-01-27T16:40:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-01-27T16:40:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:40:55.502 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:55 smithi094 bash[24555]: t=2021-01-27T16:40:55+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-01-27T16:40:55.503 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:55 smithi094 bash[24555]: t=2021-01-27T16:40:55+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-01-27T16:40:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:55 smithi106 bash[9795]: cluster 2021-01-27T16:40:55.419603+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:55.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:55 smithi106 bash[13484]: cluster 2021-01-27T16:40:55.419603+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:55.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:55 smithi094 bash[24555]: t=2021-01-27T16:40:55+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-01-27T16:40:55.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:55 smithi094 bash[9811]: cluster 2021-01-27T16:40:55.419603+0000 mgr.y (mgr.14138) 377 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:40:56.286 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-01-27T16:40:56.287 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-01-27T16:40:56.660 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 systemd[1]: Stopping Ceph prometheus.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c... 2021-01-27T16:40:56.660 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-01-27T16:40:56.661 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-01-27T16:40:56.661 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-01-27T16:40:56.945 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-01-27T16:40:56.946 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-01-27T16:40:56.946 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=warn ts=2021-01-27T16:40:56.660Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-01-27T16:40:56.946 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-01-27T16:40:56.946 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-01-27T16:40:56.947 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:583 msg="Stopping scrape manager..." 2021-01-27T16:40:56.947 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-01-27T16:40:56.947 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-01-27T16:40:56.947 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-01-27T16:40:56.947 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-01-27T16:40:56.948 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:577 msg="Scrape manager stopped" 2021-01-27T16:40:56.948 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-01-27T16:40:56.948 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.661Z caller=main.go:749 msg="Notifier manager stopped" 2021-01-27T16:40:56.948 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[23208]: level=info ts=2021-01-27T16:40:56.662Z caller=main.go:761 msg="See you next time!" 2021-01-27T16:40:57.208 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:56 smithi094 bash[24555]: t=2021-01-27T16:40:56+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-01-27T16:40:57.536 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:57 smithi094 bash[24555]: t=2021-01-27T16:40:57+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-01-27T16:40:57.989 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:57 smithi094 bash[24555]: t=2021-01-27T16:40:57+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-01-27T16:40:57.989 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:57 smithi094 bash[24555]: t=2021-01-27T16:40:57+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-01-27T16:40:58.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:57 smithi094 bash[9811]: cluster 2021-01-27T16:40:57.420313+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:58.287 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:57 smithi094 docker[25143]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c-prometheus.a 2021-01-27T16:40:58.288 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:58 smithi094 systemd[1]: ceph-294bdd66-60bd-11eb-8f9a-001a4aab830c@prometheus.a.service: Succeeded. 2021-01-27T16:40:58.288 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:58 smithi094 systemd[1]: Stopped Ceph prometheus.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:58.289 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:40:58 smithi094 systemd[1]: Started Ceph prometheus.a for 294bdd66-60bd-11eb-8f9a-001a4aab830c. 2021-01-27T16:40:58.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:58 smithi094 bash[24555]: t=2021-01-27T16:40:58+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-01-27T16:40:58.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:58 smithi094 bash[24555]: t=2021-01-27T16:40:58+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-01-27T16:40:58.401 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:57 smithi106 bash[9795]: cluster 2021-01-27T16:40:57.420313+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:58.402 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:57 smithi106 bash[13484]: cluster 2021-01-27T16:40:57.420313+0000 mgr.y (mgr.14138) 378 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:40:58.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:58 smithi094 bash[24555]: t=2021-01-27T16:40:58+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-01-27T16:40:58.809 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:40:59.135 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[24555]: t=2021-01-27T16:40:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-01-27T16:40:59.139 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.135928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.140 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.144192+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.140 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.145062+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.140 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.146922+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.140 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.147675+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.140 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.153300+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.141 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.162139+0000 mon.a (mon.0) 632 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.141 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.162653+0000 mgr.y (mgr.14138) 381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.141 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.170761+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.141 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.171242+0000 mgr.y (mgr.14138) 382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.142 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.177607+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.142 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.186077+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.142 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.186714+0000 mgr.y (mgr.14138) 383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.142 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.195961+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.142 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.196624+0000 mgr.y (mgr.14138) 384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.143 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.202675+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.143 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.209789+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.143 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.210384+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.143 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[9811]: audit 2021-01-27T16:40:58.799002+0000 mon.a (mon.0) 640 : audit [DBG] from='client.? 172.21.15.106:0/3035763195' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T16:40:59.453 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[24555]: t=2021-01-27T16:40:59+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-01-27T16:40:59.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.135928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.144192+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.145062+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.146922+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.147675+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.153300+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.162139+0000 mon.a (mon.0) 632 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.162653+0000 mgr.y (mgr.14138) 381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.170761+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.171242+0000 mgr.y (mgr.14138) 382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.458 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.177607+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.458 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.186077+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.458 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.186714+0000 mgr.y (mgr.14138) 383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.459 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.195961+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.459 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.196624+0000 mgr.y (mgr.14138) 384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.459 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.202675+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.459 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.209789+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.460 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.210384+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.460 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[9795]: audit 2021-01-27T16:40:58.799002+0000 mon.a (mon.0) 640 : audit [DBG] from='client.? 172.21.15.106:0/3035763195' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T16:40:59.461 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.135928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.461 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.144192+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.461 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.145062+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-27T16:40:59.461 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.146922+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.462 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.147675+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi106:9093"}]: dispatch 2021-01-27T16:40:59.462 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.153300+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.462 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.162139+0000 mon.a (mon.0) 632 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.463 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.162653+0000 mgr.y (mgr.14138) 381 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-27T16:40:59.463 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.170761+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.463 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.171242+0000 mgr.y (mgr.14138) 382 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi094:9095"}]: dispatch 2021-01-27T16:40:59.464 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.177607+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.464 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.186077+0000 mon.a (mon.0) 635 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.464 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.186714+0000 mgr.y (mgr.14138) 383 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-27T16:40:59.465 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.195961+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.465 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.196624+0000 mgr.y (mgr.14138) 384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi094:3000"}]: dispatch 2021-01-27T16:40:59.465 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.202675+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:40:59.466 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.209789+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.466 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.210384+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-27T16:40:59.466 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:40:59 smithi106 bash[13484]: audit 2021-01-27T16:40:58.799002+0000 mon.a (mon.0) 640 : audit [DBG] from='client.? 172.21.15.106:0/3035763195' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-27T16:40:59.699 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":1424469826},{"type":"v1","addr":"172.21.15.106:6801","nonce":1424469826}]},"active_addr":"172.21.15.106:6801/1424469826","active_change":"2021-01-27T16:33:25.213756+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":24118,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi106.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":579765217}]},{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3461653588}]},{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2367295265}]}]}} 2021-01-27T16:40:59.704 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-01-27T16:40:59.704 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-01-27T16:40:59.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T16:40:59.770 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[24555]: t=2021-01-27T16:40:59+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-01-27T16:40:59.854 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:00.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:40:59 smithi094 bash[24555]: t=2021-01-27T16:40:59+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-01-27T16:41:00.355 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-01-27T16:41:00.356 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-01-27T16:41:00.356 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[9811]: cluster 2021-01-27T16:40:59.421288+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:00.356 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[9811]: audit 2021-01-27T16:40:59.802546+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:00.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:00 smithi106 bash[13484]: cluster 2021-01-27T16:40:59.421288+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:00.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:00 smithi106 bash[13484]: audit 2021-01-27T16:40:59.802546+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:00.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:00 smithi106 bash[9795]: cluster 2021-01-27T16:40:59.421288+0000 mgr.y (mgr.14138) 385 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:00.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:00 smithi106 bash[9795]: audit 2021-01-27T16:40:59.802546+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:00.653 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-01-27T16:41:00.653 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-01-27T16:41:00.653 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-01-27T16:41:00.654 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-01-27T16:41:00.939 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-01-27T16:41:00.939 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-01-27T16:41:00.939 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-01-27T16:41:00.940 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-27T16:41:00.940 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-27T16:41:00.940 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-27T16:41:00.940 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi094 (none))" 2021-01-27T16:41:00.940 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-27T16:41:00.941 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.660Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-27T16:41:00.941 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.663Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-27T16:41:00.941 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.663Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-27T16:41:00.941 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.668Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-27T16:41:00.942 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.669Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-01-27T16:41:00.942 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.669Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-01-27T16:41:00.942 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.669Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=540.33µs 2021-01-27T16:41:00.942 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.670Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-27T16:41:00.942 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.670Z caller=main.go:695 msg="TSDB started" 2021-01-27T16:41:00.943 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.670Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T16:41:00.943 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.671Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-27T16:41:00.943 INFO:journalctl@ceph.prometheus.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[25189]: level=info ts=2021-01-27T16:41:00.671Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-27T16:41:00.954 INFO:journalctl@ceph.alertmanager.a.smithi106.stdout:Jan 27 16:41:00 smithi106 bash[28316]: level=info ts=2021-01-27T16:41:00.593Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000889127s 2021-01-27T16:41:01.241 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:00 smithi094 bash[24555]: t=2021-01-27T16:41:00+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-01-27T16:41:01.242 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-01-27T16:41:01.242 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-01-27T16:41:01.242 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-01-27T16:41:01.502 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-01-27T16:41:01.502 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-01-27T16:41:01.502 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-01-27T16:41:01.704 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:01 smithi106 bash[10032]: debug 2021-01-27T16:41:01.593+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:01.786 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:01.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-01-27T16:41:01.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-01-27T16:41:01.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-01-27T16:41:01.787 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-01-27T16:41:02.181 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-01-27T16:41:02.182 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-01-27T16:41:02.182 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:01 smithi094 bash[24555]: t=2021-01-27T16:41:01+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-01-27T16:41:02.182 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-01-27T16:41:02.442 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-01-27T16:41:02.443 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-01-27T16:41:02.443 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-01-27T16:41:02.444 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: audit 2021-01-27T16:41:01.388381+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.444 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: audit 2021-01-27T16:41:01.395073+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.444 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.396503+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.444 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.397571+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.398441+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.399296+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.400347+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.401554+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.445 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.402575+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: audit 2021-01-27T16:41:01.413363+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.414419+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.414957+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.446 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.415557+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.447 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.416071+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.447 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.416583+0000 mgr.y (mgr.14138) 397 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.447 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.417099+0000 mgr.y (mgr.14138) 398 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.447 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cephadm 2021-01-27T16:41:01.417607+0000 mgr.y (mgr.14138) 399 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.448 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[9811]: cluster 2021-01-27T16:41:01.422256+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:02.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: audit 2021-01-27T16:41:01.388381+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: audit 2021-01-27T16:41:01.395073+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.396503+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.397571+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.398441+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.399296+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.400347+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.401554+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.402575+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: audit 2021-01-27T16:41:01.413363+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.414419+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.414957+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.415557+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.416071+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.416583+0000 mgr.y (mgr.14138) 397 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.709 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.417099+0000 mgr.y (mgr.14138) 398 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.709 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cephadm 2021-01-27T16:41:01.417607+0000 mgr.y (mgr.14138) 399 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.709 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[9795]: cluster 2021-01-27T16:41:01.422256+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:02.709 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: audit 2021-01-27T16:41:01.388381+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: audit 2021-01-27T16:41:01.395073+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.396503+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.397571+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.398441+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.399296+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.711 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.400347+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.711 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.401554+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.711 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.402575+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.711 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: audit 2021-01-27T16:41:01.413363+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' 2021-01-27T16:41:02.712 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.414419+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='y'), HostPlacementSpec(hostname='smithi094', network='', name='x')] + new hosts [] 2021-01-27T16:41:02.712 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.414957+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='realm.zone.a')] + new hosts [] 2021-01-27T16:41:02.712 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.415557+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='iscsi.a')] + new hosts [] 2021-01-27T16:41:02.712 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.416071+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.712 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.416583+0000 mgr.y (mgr.14138) 397 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a'), HostPlacementSpec(hostname='smithi094', network='', name='b')] + new hosts [] 2021-01-27T16:41:02.713 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.417099+0000 mgr.y (mgr.14138) 398 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi106', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.713 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cephadm 2021-01-27T16:41:01.417607+0000 mgr.y (mgr.14138) 399 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi094', network='', name='a')] + new hosts [] 2021-01-27T16:41:02.713 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:02 smithi106 bash[13484]: cluster 2021-01-27T16:41:01.422256+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:02.785 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-01-27T16:41:02.785 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-01-27T16:41:02.785 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-01-27T16:41:02.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-01-27T16:41:02.786 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-01-27T16:41:03.036 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-01-27T16:41:03.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:02 smithi094 bash[24555]: t=2021-01-27T16:41:02+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-01-27T16:41:03.037 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-01-27T16:41:03.371 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-01-27T16:41:03.371 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-01-27T16:41:03.372 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-01-27T16:41:03.525 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:41:03.526 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":61,"fsid":"294bdd66-60bd-11eb-8f9a-001a4aab830c","created":"2021-01-27T16:32:29.045691+0000","modified":"2021-01-27T16:40:26.362995+0000","last_up_change":"2021-01-27T16:39:07.566656+0000","last_in_change":"2021-01-27T16:39:07.566656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T16:34:20.360029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T16:39:03.472231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T16:39:23.212926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T16:39:23.719884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T16:39:25.726193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T16:39:28.758474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"602f7089-9ced-4651-aec4-152bc61f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6803","nonce":2604730968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6805","nonce":2604730968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6809","nonce":2604730968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6807","nonce":2604730968}]},"public_addr":"172.21.15.106:6803/2604730968","cluster_addr":"172.21.15.106:6805/2604730968","heartbeat_back_addr":"172.21.15.106:6809/2604730968","heartbeat_front_addr":"172.21.15.106:6807/2604730968","state":["exists","up"]},{"osd":1,"uuid":"49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6811","nonce":3792678646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6813","nonce":3792678646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6817","nonce":3792678646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6815","nonce":3792678646}]},"public_addr":"172.21.15.106:6811/3792678646","cluster_addr":"172.21.15.106:6813/3792678646","heartbeat_back_addr":"172.21.15.106:6817/3792678646","heartbeat_front_addr":"172.21.15.106:6815/3792678646","state":["exists","up"]},{"osd":2,"uuid":"e3312df2-156f-4ecf-81b4-7b5cc0fabd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6819","nonce":2900657738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6821","nonce":2900657738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6825","nonce":2900657738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6823","nonce":2900657738}]},"public_addr":"172.21.15.106:6819/2900657738","cluster_addr":"172.21.15.106:6821/2900657738","heartbeat_back_addr":"172.21.15.106:6825/2900657738","heartbeat_front_addr":"172.21.15.106:6823/2900657738","state":["exists","up"]},{"osd":3,"uuid":"3482f065-fb56-419b-9661-976fe0fe2a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6827","nonce":2657826375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6829","nonce":2657826375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6833","nonce":2657826375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6831","nonce":2657826375}]},"public_addr":"172.21.15.106:6827/2657826375","cluster_addr":"172.21.15.106:6829/2657826375","heartbeat_back_addr":"172.21.15.106:6833/2657826375","heartbeat_front_addr":"172.21.15.106:6831/2657826375","state":["exists","up"]},{"osd":4,"uuid":"bace9ab3-237b-4ed3-a0b8-fae82cac33b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6801","nonce":4275584131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6803","nonce":4275584131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6807","nonce":4275584131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6805","nonce":4275584131}]},"public_addr":"172.21.15.94:6801/4275584131","cluster_addr":"172.21.15.94:6803/4275584131","heartbeat_back_addr":"172.21.15.94:6807/4275584131","heartbeat_front_addr":"172.21.15.94:6805/4275584131","state":["exists","up"]},{"osd":5,"uuid":"53460a4a-1c49-4f75-961a-c6e08e18fbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6809","nonce":624844330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6811","nonce":624844330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6815","nonce":624844330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6813","nonce":624844330}]},"public_addr":"172.21.15.94:6809/624844330","cluster_addr":"172.21.15.94:6811/624844330","heartbeat_back_addr":"172.21.15.94:6815/624844330","heartbeat_front_addr":"172.21.15.94:6813/624844330","state":["exists","up"]},{"osd":6,"uuid":"0133a60f-9d9e-4173-a081-8967e48630ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6817","nonce":1928175091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6819","nonce":1928175091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6823","nonce":1928175091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6821","nonce":1928175091}]},"public_addr":"172.21.15.94:6817/1928175091","cluster_addr":"172.21.15.94:6819/1928175091","heartbeat_back_addr":"172.21.15.94:6823/1928175091","heartbeat_front_addr":"172.21.15.94:6821/1928175091","state":["exists","up"]},{"osd":7,"uuid":"3ee57c5f-098b-4032-8cd6-265cd1c5c34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6825","nonce":974148326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6827","nonce":974148326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6831","nonce":974148326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6829","nonce":974148326}]},"public_addr":"172.21.15.94:6825/974148326","cluster_addr":"172.21.15.94:6827/974148326","heartbeat_back_addr":"172.21.15.94:6831/974148326","heartbeat_front_addr":"172.21.15.94:6829/974148326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:35:39.387958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:08.089459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:36.683542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:03.637665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:32.024392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:04.188215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:34.521324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:39:05.986637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:0/1539490405":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/1613508695":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/2883723824":"2021-01-28T16:33:03.753341+0000","172.21.15.106:0/1720539314":"2021-01-28T16:33:03.753341+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T16:41:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:03 smithi106 bash[9795]: audit 2021-01-27T16:41:01.596411+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:03.845 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:03 smithi106 bash[13484]: audit 2021-01-27T16:41:01.596411+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:03.846 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[9811]: audit 2021-01-27T16:41:01.596411+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:03.847 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-01-27T16:41:03.847 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-01-27T16:41:03.847 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-01-27T16:41:03.847 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-01-27T16:41:03.848 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-01-27T16:41:04.009 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-01-27T16:41:04.009 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:03 smithi094 bash[24555]: t=2021-01-27T16:41:03+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-01-27T16:41:04.286 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-01-27T16:41:04.287 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-01-27T16:41:04.287 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-01-27T16:41:04.287 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-01-27T16:41:04.288 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-01-27T16:41:04.288 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-01-27T16:41:04.288 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-01-27T16:41:04.288 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing HooksService" logger=server 2021-01-27T16:41:04.288 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-01-27T16:41:04.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-01-27T16:41:04.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-01-27T16:41:04.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-01-27T16:41:04.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-01-27T16:41:04.289 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-01-27T16:41:04.290 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-01-27T16:41:04.290 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-01-27T16:41:04.290 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-01-27T16:41:04.290 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing LoginService" logger=server 2021-01-27T16:41:04.291 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing SearchService" logger=server 2021-01-27T16:41:04.291 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing TracingService" logger=server 2021-01-27T16:41:04.291 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-01-27T16:41:04.291 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-01-27T16:41:04.291 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-01-27T16:41:04.292 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-01-27T16:41:04.292 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-01-27T16:41:04.292 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-01-27T16:41:04.292 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-01-27T16:41:04.292 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-01-27T16:41:04.293 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="Initializing Stream Manager" 2021-01-27T16:41:04.293 INFO:journalctl@ceph.grafana.a.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[24555]: t=2021-01-27T16:41:04+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-01-27T16:41:04.323 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-01-27T16:41:04.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd dump --format=json 2021-01-27T16:41:04.475 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:04.709 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:04 smithi106 bash[9795]: cluster 2021-01-27T16:41:03.423607+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:04.709 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:04 smithi106 bash[9795]: audit 2021-01-27T16:41:03.522218+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.15.106:0/2804079761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:04.709 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:04 smithi106 bash[13484]: cluster 2021-01-27T16:41:03.423607+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:04.710 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:04 smithi106 bash[13484]: audit 2021-01-27T16:41:03.522218+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.15.106:0/2804079761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[9811]: cluster 2021-01-27T16:41:03.423607+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:04 smithi094 bash[9811]: audit 2021-01-27T16:41:03.522218+0000 mon.a (mon.0) 645 : audit [DBG] from='client.? 172.21.15.106:0/2804079761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:05.785 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:05 smithi106 bash[9795]: cluster 2021-01-27T16:41:05.424704+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:05.786 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:05 smithi106 bash[13484]: cluster 2021-01-27T16:41:05.424704+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:05 smithi094 bash[9811]: cluster 2021-01-27T16:41:05.424704+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:07.940 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:41:07.940 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":61,"fsid":"294bdd66-60bd-11eb-8f9a-001a4aab830c","created":"2021-01-27T16:32:29.045691+0000","modified":"2021-01-27T16:40:26.362995+0000","last_up_change":"2021-01-27T16:39:07.566656+0000","last_in_change":"2021-01-27T16:39:07.566656+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-27T16:34:20.360029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-27T16:39:03.472231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-27T16:39:23.212926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-27T16:39:23.719884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-27T16:39:25.726193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-27T16:39:28.758474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"602f7089-9ced-4651-aec4-152bc61f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6803","nonce":2604730968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6805","nonce":2604730968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6809","nonce":2604730968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":2604730968},{"type":"v1","addr":"172.21.15.106:6807","nonce":2604730968}]},"public_addr":"172.21.15.106:6803/2604730968","cluster_addr":"172.21.15.106:6805/2604730968","heartbeat_back_addr":"172.21.15.106:6809/2604730968","heartbeat_front_addr":"172.21.15.106:6807/2604730968","state":["exists","up"]},{"osd":1,"uuid":"49a52cbe-f5aa-4cdf-9e2f-041a7f5718aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6811","nonce":3792678646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6813","nonce":3792678646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6817","nonce":3792678646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":3792678646},{"type":"v1","addr":"172.21.15.106:6815","nonce":3792678646}]},"public_addr":"172.21.15.106:6811/3792678646","cluster_addr":"172.21.15.106:6813/3792678646","heartbeat_back_addr":"172.21.15.106:6817/3792678646","heartbeat_front_addr":"172.21.15.106:6815/3792678646","state":["exists","up"]},{"osd":2,"uuid":"e3312df2-156f-4ecf-81b4-7b5cc0fabd9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6819","nonce":2900657738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6821","nonce":2900657738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6825","nonce":2900657738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2900657738},{"type":"v1","addr":"172.21.15.106:6823","nonce":2900657738}]},"public_addr":"172.21.15.106:6819/2900657738","cluster_addr":"172.21.15.106:6821/2900657738","heartbeat_back_addr":"172.21.15.106:6825/2900657738","heartbeat_front_addr":"172.21.15.106:6823/2900657738","state":["exists","up"]},{"osd":3,"uuid":"3482f065-fb56-419b-9661-976fe0fe2a91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6827","nonce":2657826375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6829","nonce":2657826375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6833","nonce":2657826375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2657826375},{"type":"v1","addr":"172.21.15.106:6831","nonce":2657826375}]},"public_addr":"172.21.15.106:6827/2657826375","cluster_addr":"172.21.15.106:6829/2657826375","heartbeat_back_addr":"172.21.15.106:6833/2657826375","heartbeat_front_addr":"172.21.15.106:6831/2657826375","state":["exists","up"]},{"osd":4,"uuid":"bace9ab3-237b-4ed3-a0b8-fae82cac33b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6801","nonce":4275584131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6803","nonce":4275584131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6807","nonce":4275584131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":4275584131},{"type":"v1","addr":"172.21.15.94:6805","nonce":4275584131}]},"public_addr":"172.21.15.94:6801/4275584131","cluster_addr":"172.21.15.94:6803/4275584131","heartbeat_back_addr":"172.21.15.94:6807/4275584131","heartbeat_front_addr":"172.21.15.94:6805/4275584131","state":["exists","up"]},{"osd":5,"uuid":"53460a4a-1c49-4f75-961a-c6e08e18fbd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6809","nonce":624844330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6811","nonce":624844330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6815","nonce":624844330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":624844330},{"type":"v1","addr":"172.21.15.94:6813","nonce":624844330}]},"public_addr":"172.21.15.94:6809/624844330","cluster_addr":"172.21.15.94:6811/624844330","heartbeat_back_addr":"172.21.15.94:6815/624844330","heartbeat_front_addr":"172.21.15.94:6813/624844330","state":["exists","up"]},{"osd":6,"uuid":"0133a60f-9d9e-4173-a081-8967e48630ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6817","nonce":1928175091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6819","nonce":1928175091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6823","nonce":1928175091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":1928175091},{"type":"v1","addr":"172.21.15.94:6821","nonce":1928175091}]},"public_addr":"172.21.15.94:6817/1928175091","cluster_addr":"172.21.15.94:6819/1928175091","heartbeat_back_addr":"172.21.15.94:6823/1928175091","heartbeat_front_addr":"172.21.15.94:6821/1928175091","state":["exists","up"]},{"osd":7,"uuid":"3ee57c5f-098b-4032-8cd6-265cd1c5c34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6825","nonce":974148326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6827","nonce":974148326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6831","nonce":974148326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":974148326},{"type":"v1","addr":"172.21.15.94:6829","nonce":974148326}]},"public_addr":"172.21.15.94:6825/974148326","cluster_addr":"172.21.15.94:6827/974148326","heartbeat_back_addr":"172.21.15.94:6831/974148326","heartbeat_front_addr":"172.21.15.94:6829/974148326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:35:39.387958+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:08.089459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:36:36.683542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:03.637665+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:37:32.024392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:04.188215+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:38:34.521324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-01-27T16:39:05.986637+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:0/1539490405":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/1613508695":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:6800/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/2106485361":"2021-01-28T16:33:03.753341+0000","172.21.15.106:6801/3590128432":"2021-01-28T16:33:25.213315+0000","172.21.15.106:0/2883723824":"2021-01-28T16:33:03.753341+0000","172.21.15.106:0/1720539314":"2021-01-28T16:33:03.753341+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-27T16:41:08.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:07 smithi094 bash[9811]: cluster 2021-01-27T16:41:07.425877+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:08.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:07 smithi094 bash[9811]: audit 2021-01-27T16:41:07.936725+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.106:0/1131608955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:08.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:07 smithi106 bash[9795]: cluster 2021-01-27T16:41:07.425877+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:08.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:07 smithi106 bash[9795]: audit 2021-01-27T16:41:07.936725+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.106:0/1131608955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:08.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:07 smithi106 bash[13484]: cluster 2021-01-27T16:41:07.425877+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:08.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:07 smithi106 bash[13484]: audit 2021-01-27T16:41:07.936725+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.106:0/1131608955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:41:08.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-01-27T16:41:08.878 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:09.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:09 smithi094 bash[9811]: cluster 2021-01-27T16:41:09.426954+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:09.936 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:09 smithi106 bash[9795]: cluster 2021-01-27T16:41:09.426954+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:09.936 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:09 smithi106 bash[13484]: cluster 2021-01-27T16:41:09.426954+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:11.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:11 smithi094 bash[9811]: cluster 2021-01-27T16:41:11.428066+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:11.787 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:11.801 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:11 smithi106 bash[10032]: debug 2021-01-27T16:41:11.600+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:11.801 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:11 smithi106 bash[9795]: cluster 2021-01-27T16:41:11.428066+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:11.802 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:11 smithi106 bash[13484]: cluster 2021-01-27T16:41:11.428066+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:12.854 INFO:teuthology.orchestra.run.smithi106.stdout:42949673028 2021-01-27T16:41:12.855 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-01-27T16:41:13.005 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:13.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:12 smithi106 bash[9795]: audit 2021-01-27T16:41:11.604295+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:13.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:12 smithi106 bash[13484]: audit 2021-01-27T16:41:11.604295+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:13.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:12 smithi094 bash[9811]: audit 2021-01-27T16:41:11.604295+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:13 smithi094 bash[9811]: cluster 2021-01-27T16:41:13.429248+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:14.375 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:13 smithi106 bash[9795]: cluster 2021-01-27T16:41:13.429248+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:14.376 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:13 smithi106 bash[13484]: cluster 2021-01-27T16:41:13.429248+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:15.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:15 smithi094 bash[9811]: cluster 2021-01-27T16:41:15.430339+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:15.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:15 smithi106 bash[9795]: cluster 2021-01-27T16:41:15.430339+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:15 smithi106 bash[13484]: cluster 2021-01-27T16:41:15.430339+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:17.049 INFO:teuthology.orchestra.run.smithi106.stdout:68719476800 2021-01-27T16:41:17.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-01-27T16:41:17.199 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:18.274 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:17 smithi106 bash[9795]: cluster 2021-01-27T16:41:17.431587+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:18.275 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:17 smithi106 bash[13484]: cluster 2021-01-27T16:41:17.431587+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:17 smithi094 bash[9811]: cluster 2021-01-27T16:41:17.431587+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:19.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:19 smithi094 bash[9811]: cluster 2021-01-27T16:41:19.432650+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:19.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:19 smithi106 bash[9795]: cluster 2021-01-27T16:41:19.432650+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:19.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:19 smithi106 bash[13484]: cluster 2021-01-27T16:41:19.432650+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2021-01-27T16:41:21.448 INFO:teuthology.orchestra.run.smithi106.stdout:90194313275 2021-01-27T16:41:21.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-01-27T16:41:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:21.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:21 smithi106 bash[9795]: cluster 2021-01-27T16:41:21.433735+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:21.704 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:21 smithi106 bash[10032]: debug 2021-01-27T16:41:21.608+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:21.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:21 smithi106 bash[13484]: cluster 2021-01-27T16:41:21.433735+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:21.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:21 smithi094 bash[9811]: cluster 2021-01-27T16:41:21.433735+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:21.787 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:22 smithi094 bash[9811]: audit 2021-01-27T16:41:21.613340+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:23.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:22 smithi106 bash[9795]: audit 2021-01-27T16:41:21.613340+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:23.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:22 smithi106 bash[13484]: audit 2021-01-27T16:41:21.613340+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:24.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:24 smithi094 bash[9811]: cluster 2021-01-27T16:41:23.434828+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:24.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:23 smithi106 bash[9795]: cluster 2021-01-27T16:41:23.434828+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:24.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:23 smithi106 bash[13484]: cluster 2021-01-27T16:41:23.434828+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:25.712 INFO:teuthology.orchestra.run.smithi106.stdout:111669149750 2021-01-27T16:41:25.712 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-01-27T16:41:25.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:25 smithi094 bash[9811]: cluster 2021-01-27T16:41:25.436016+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:25.865 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:25.913 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:25 smithi106 bash[9795]: cluster 2021-01-27T16:41:25.436016+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:25.913 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:25 smithi106 bash[13484]: cluster 2021-01-27T16:41:25.436016+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:26.923 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:26 smithi106 bash[9795]: audit 2021-01-27T16:41:25.742938+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:41:26.924 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:26 smithi106 bash[9795]: audit 2021-01-27T16:41:25.745322+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:41:26.924 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:26 smithi106 bash[13484]: audit 2021-01-27T16:41:25.742938+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:41:26.924 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:26 smithi106 bash[13484]: audit 2021-01-27T16:41:25.745322+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:41:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:26 smithi094 bash[9811]: audit 2021-01-27T16:41:25.742938+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:41:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:26 smithi094 bash[9811]: audit 2021-01-27T16:41:25.745322+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:41:28.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:28 smithi106 bash[9795]: cluster 2021-01-27T16:41:27.437087+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:28.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:28 smithi106 bash[13484]: cluster 2021-01-27T16:41:27.437087+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:28 smithi094 bash[9811]: cluster 2021-01-27T16:41:27.437087+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:29.823 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:29 smithi106 bash[9795]: cluster 2021-01-27T16:41:29.438095+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:41:29.824 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:29 smithi106 bash[13484]: cluster 2021-01-27T16:41:29.438095+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:41:29.825 INFO:teuthology.orchestra.run.smithi106.stdout:133143986226 2021-01-27T16:41:29.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-01-27T16:41:29.975 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:29 smithi094 bash[9811]: cluster 2021-01-27T16:41:29.438095+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:41:31.641 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:31 smithi106 bash[9795]: cluster 2021-01-27T16:41:31.439226+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:31.642 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:31 smithi106 bash[13484]: cluster 2021-01-27T16:41:31.439226+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:31.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:31 smithi106 bash[10032]: debug 2021-01-27T16:41:31.620+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:32.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:31 smithi094 bash[9811]: cluster 2021-01-27T16:41:31.439226+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:32.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:33.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:32 smithi094 bash[9811]: audit 2021-01-27T16:41:31.624692+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:33.298 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:32 smithi106 bash[9795]: audit 2021-01-27T16:41:31.624692+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:33.298 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:32 smithi106 bash[13484]: audit 2021-01-27T16:41:31.624692+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:34.107 INFO:teuthology.orchestra.run.smithi106.stdout:154618822700 2021-01-27T16:41:34.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-01-27T16:41:34.263 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:34.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:34 smithi094 bash[9811]: cluster 2021-01-27T16:41:33.440516+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:34.311 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:34 smithi106 bash[9795]: cluster 2021-01-27T16:41:33.440516+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:34.311 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:34 smithi106 bash[13484]: cluster 2021-01-27T16:41:33.440516+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:35.640 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:35 smithi106 bash[9795]: cluster 2021-01-27T16:41:35.441461+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:35.641 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:35 smithi106 bash[13484]: cluster 2021-01-27T16:41:35.441461+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:36.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:35 smithi094 bash[9811]: cluster 2021-01-27T16:41:35.441461+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:38.260 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:37 smithi106 bash[9795]: cluster 2021-01-27T16:41:37.442521+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:38.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:38 smithi106 bash[13484]: cluster 2021-01-27T16:41:37.442521+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:38.261 INFO:teuthology.orchestra.run.smithi106.stdout:176093659176 2021-01-27T16:41:38.262 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-01-27T16:41:38.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:38 smithi094 bash[9811]: cluster 2021-01-27T16:41:37.442521+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:38.421 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:39.815 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:39 smithi106 bash[9795]: cluster 2021-01-27T16:41:39.443654+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:39.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:39 smithi106 bash[13484]: cluster 2021-01-27T16:41:39.443654+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:40.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:39 smithi094 bash[9811]: cluster 2021-01-27T16:41:39.443654+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:41.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:41 smithi106 bash[9795]: cluster 2021-01-27T16:41:41.444559+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:41.704 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:41 smithi106 bash[10032]: debug 2021-01-27T16:41:41.628+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:41.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:41 smithi106 bash[13484]: cluster 2021-01-27T16:41:41.444559+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:42.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:41 smithi094 bash[9811]: cluster 2021-01-27T16:41:41.444559+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:42.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:42.492 INFO:teuthology.orchestra.run.smithi106.stdout:206158430240 2021-01-27T16:41:42.492 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-01-27T16:41:42.650 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:43.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:42 smithi094 bash[9811]: audit 2021-01-27T16:41:41.633033+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:42 smithi106 bash[9795]: audit 2021-01-27T16:41:41.633033+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:43.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:42 smithi106 bash[13484]: audit 2021-01-27T16:41:41.633033+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:44.163 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:44 smithi106 bash[9795]: cluster 2021-01-27T16:41:43.445720+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:44.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:44 smithi106 bash[13484]: cluster 2021-01-27T16:41:43.445720+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:44.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:44 smithi094 bash[9811]: cluster 2021-01-27T16:41:43.445720+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:45.855 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:45 smithi106 bash[9795]: cluster 2021-01-27T16:41:45.446783+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:45.856 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:45 smithi106 bash[13484]: cluster 2021-01-27T16:41:45.446783+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:46.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:45 smithi094 bash[9811]: cluster 2021-01-27T16:41:45.446783+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:46.164 INFO:teuthology.orchestra.run.smithi106.stdout:42949673035 2021-01-27T16:41:46.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:46 smithi106 bash[9795]: audit 2021-01-27T16:41:46.164162+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.106:0/2996692203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T16:41:46.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:46 smithi106 bash[13484]: audit 2021-01-27T16:41:46.164162+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.106:0/2996692203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T16:41:47.014 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673028 got 42949673035 for osd.0 2021-01-27T16:41:47.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-01-27T16:41:47.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:46 smithi094 bash[9811]: audit 2021-01-27T16:41:46.164162+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.106:0/2996692203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-27T16:41:47.160 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:48.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:48 smithi094 bash[9811]: cluster 2021-01-27T16:41:47.447912+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:48.295 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:47 smithi106 bash[9795]: cluster 2021-01-27T16:41:47.447912+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:48.296 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:47 smithi106 bash[13484]: cluster 2021-01-27T16:41:47.447912+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:49.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:49 smithi106 bash[9795]: cluster 2021-01-27T16:41:49.448931+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:49.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:49 smithi106 bash[13484]: cluster 2021-01-27T16:41:49.448931+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:50.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:49 smithi094 bash[9811]: cluster 2021-01-27T16:41:49.448931+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:50.741 INFO:teuthology.orchestra.run.smithi106.stdout:68719476806 2021-01-27T16:41:51.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:50 smithi106 bash[9795]: audit 2021-01-27T16:41:50.740732+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.106:0/509008116' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T16:41:51.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:50 smithi106 bash[13484]: audit 2021-01-27T16:41:50.740732+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.106:0/509008116' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T16:41:51.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:50 smithi094 bash[9811]: audit 2021-01-27T16:41:50.740732+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.106:0/509008116' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-27T16:41:51.595 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476800 got 68719476806 for osd.1 2021-01-27T16:41:51.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-01-27T16:41:51.740 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:51.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:51 smithi106 bash[9795]: cluster 2021-01-27T16:41:51.450164+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:51.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:41:51 smithi106 bash[10032]: debug 2021-01-27T16:41:51.636+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:41:51.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:51 smithi106 bash[13484]: cluster 2021-01-27T16:41:51.450164+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:52.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:51 smithi094 bash[9811]: cluster 2021-01-27T16:41:51.450164+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:52.039 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:41:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:41:53.097 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:52 smithi106 bash[9795]: audit 2021-01-27T16:41:51.641212+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:53.097 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:53 smithi106 bash[13484]: audit 2021-01-27T16:41:51.641212+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:53 smithi094 bash[9811]: audit 2021-01-27T16:41:51.641212+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:41:54.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:54 smithi094 bash[9811]: cluster 2021-01-27T16:41:53.451372+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:54.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:54 smithi106 bash[9795]: cluster 2021-01-27T16:41:53.451372+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:54.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:54 smithi106 bash[13484]: cluster 2021-01-27T16:41:53.451372+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:55.144 INFO:teuthology.orchestra.run.smithi106.stdout:90194313281 2021-01-27T16:41:55.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:55 smithi106 bash[9795]: audit 2021-01-27T16:41:55.143706+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.106:0/4240104891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T16:41:55.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:55 smithi106 bash[13484]: audit 2021-01-27T16:41:55.143706+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.106:0/4240104891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T16:41:55.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:55 smithi094 bash[9811]: audit 2021-01-27T16:41:55.143706+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.106:0/4240104891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-27T16:41:55.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313275 got 90194313281 for osd.2 2021-01-27T16:41:55.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-01-27T16:41:56.106 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:41:56.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:56 smithi094 bash[9811]: cluster 2021-01-27T16:41:55.452449+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:56.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:56 smithi106 bash[9795]: cluster 2021-01-27T16:41:55.452449+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:56.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:56 smithi106 bash[13484]: cluster 2021-01-27T16:41:55.452449+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:41:58.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:58 smithi094 bash[9811]: cluster 2021-01-27T16:41:57.453684+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:58.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:58 smithi106 bash[9795]: cluster 2021-01-27T16:41:57.453684+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:58.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:58 smithi106 bash[13484]: cluster 2021-01-27T16:41:57.453684+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:59.575 INFO:teuthology.orchestra.run.smithi106.stdout:111669149757 2021-01-27T16:41:59.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:41:59 smithi106 bash[9795]: cluster 2021-01-27T16:41:59.454480+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:41:59.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:41:59 smithi106 bash[13484]: cluster 2021-01-27T16:41:59.454480+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:00.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:41:59 smithi094 bash[9811]: cluster 2021-01-27T16:41:59.454480+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:00.380 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149750 got 111669149757 for osd.3 2021-01-27T16:42:00.381 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-01-27T16:42:00.538 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:00.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:00 smithi106 bash[9795]: audit 2021-01-27T16:41:59.574576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.106:0/2322013442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T16:42:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:00 smithi106 bash[13484]: audit 2021-01-27T16:41:59.574576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.106:0/2322013442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T16:42:01.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:00 smithi094 bash[9811]: audit 2021-01-27T16:41:59.574576+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.106:0/2322013442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-27T16:42:01.828 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:01 smithi106 bash[9795]: cluster 2021-01-27T16:42:01.455529+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:01.828 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:01 smithi106 bash[10032]: debug 2021-01-27T16:42:01.647+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:01.829 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:01 smithi106 bash[13484]: cluster 2021-01-27T16:42:01.455529+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:02.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:01 smithi094 bash[9811]: cluster 2021-01-27T16:42:01.455529+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:02.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:03.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:03 smithi094 bash[9811]: audit 2021-01-27T16:42:01.652544+0000 mgr.y (mgr.14138) 437 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:03.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:03 smithi106 bash[9795]: audit 2021-01-27T16:42:01.652544+0000 mgr.y (mgr.14138) 437 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:03.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:03 smithi106 bash[13484]: audit 2021-01-27T16:42:01.652544+0000 mgr.y (mgr.14138) 437 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:03.848 INFO:teuthology.orchestra.run.smithi106.stdout:133143986232 2021-01-27T16:42:04.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:04 smithi106 bash[9795]: cluster 2021-01-27T16:42:03.456675+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:04.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:04 smithi106 bash[9795]: audit 2021-01-27T16:42:03.847125+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.106:0/2787540888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T16:42:04.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:04 smithi106 bash[13484]: cluster 2021-01-27T16:42:03.456675+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:04.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:04 smithi106 bash[13484]: audit 2021-01-27T16:42:03.847125+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.106:0/2787540888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T16:42:04.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:04 smithi094 bash[9811]: cluster 2021-01-27T16:42:03.456675+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:04.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:04 smithi094 bash[9811]: audit 2021-01-27T16:42:03.847125+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.106:0/2787540888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-27T16:42:04.685 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986226 got 133143986232 for osd.4 2021-01-27T16:42:04.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-01-27T16:42:04.843 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:05.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:05 smithi106 bash[9795]: cluster 2021-01-27T16:42:05.457753+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:05.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:05 smithi106 bash[13484]: cluster 2021-01-27T16:42:05.457753+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:06.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:05 smithi094 bash[9811]: cluster 2021-01-27T16:42:05.457753+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:08.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:08 smithi094 bash[9811]: cluster 2021-01-27T16:42:07.458862+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:08.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:08 smithi106 bash[9795]: cluster 2021-01-27T16:42:07.458862+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:08.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:08 smithi106 bash[13484]: cluster 2021-01-27T16:42:07.458862+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:08.497 INFO:teuthology.orchestra.run.smithi106.stdout:154618822707 2021-01-27T16:42:09.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:09 smithi094 bash[9811]: audit 2021-01-27T16:42:08.497072+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.106:0/3696424269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T16:42:09.317 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:09 smithi106 bash[9795]: audit 2021-01-27T16:42:08.497072+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.106:0/3696424269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T16:42:09.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:09 smithi106 bash[13484]: audit 2021-01-27T16:42:08.497072+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.106:0/3696424269' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-27T16:42:09.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822700 got 154618822707 for osd.5 2021-01-27T16:42:09.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-01-27T16:42:09.470 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:10 smithi094 bash[9811]: cluster 2021-01-27T16:42:09.460009+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:10.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:10 smithi106 bash[9795]: cluster 2021-01-27T16:42:09.460009+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:10.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:10 smithi106 bash[13484]: cluster 2021-01-27T16:42:09.460009+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:11.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:11 smithi106 bash[9795]: cluster 2021-01-27T16:42:11.460998+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:11.955 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:11 smithi106 bash[10032]: debug 2021-01-27T16:42:11.659+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:11.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:11 smithi106 bash[13484]: cluster 2021-01-27T16:42:11.460998+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:12.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:11 smithi094 bash[9811]: cluster 2021-01-27T16:42:11.460998+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:12.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:13.019 INFO:teuthology.orchestra.run.smithi106.stdout:176093659182 2021-01-27T16:42:13.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:13 smithi094 bash[9811]: audit 2021-01-27T16:42:11.663920+0000 mgr.y (mgr.14138) 443 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:13.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:13 smithi106 bash[9795]: audit 2021-01-27T16:42:11.663920+0000 mgr.y (mgr.14138) 443 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:13.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:13 smithi106 bash[13484]: audit 2021-01-27T16:42:11.663920+0000 mgr.y (mgr.14138) 443 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:13.846 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659176 got 176093659182 for osd.6 2021-01-27T16:42:13.846 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-01-27T16:42:14.007 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:14.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:14 smithi106 bash[9795]: audit 2021-01-27T16:42:13.018260+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.106:0/419571129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T16:42:14.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:14 smithi106 bash[9795]: cluster 2021-01-27T16:42:13.462244+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:14.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:14 smithi106 bash[13484]: audit 2021-01-27T16:42:13.018260+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.106:0/419571129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T16:42:14.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:14 smithi106 bash[13484]: cluster 2021-01-27T16:42:13.462244+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:14 smithi094 bash[9811]: audit 2021-01-27T16:42:13.018260+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.106:0/419571129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-27T16:42:14.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:14 smithi094 bash[9811]: cluster 2021-01-27T16:42:13.462244+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:15 smithi106 bash[13484]: cluster 2021-01-27T16:42:15.463368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:15.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:15 smithi106 bash[9795]: cluster 2021-01-27T16:42:15.463368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:16.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:15 smithi094 bash[9811]: cluster 2021-01-27T16:42:15.463368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:17.502 INFO:teuthology.orchestra.run.smithi106.stdout:206158430247 2021-01-27T16:42:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:18 smithi094 bash[9811]: cluster 2021-01-27T16:42:17.464407+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:18 smithi094 bash[9811]: audit 2021-01-27T16:42:17.501882+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.106:0/978103788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T16:42:18.333 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:18 smithi106 bash[9795]: cluster 2021-01-27T16:42:17.464407+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:18.333 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:18 smithi106 bash[9795]: audit 2021-01-27T16:42:17.501882+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.106:0/978103788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T16:42:18.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:18 smithi106 bash[13484]: cluster 2021-01-27T16:42:17.464407+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:18.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:18 smithi106 bash[13484]: audit 2021-01-27T16:42:17.501882+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.106:0/978103788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-27T16:42:18.334 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430240 got 206158430247 for osd.7 2021-01-27T16:42:18.335 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-01-27T16:42:18.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T16:42:18.493 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:19.804 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:19 smithi106 bash[9795]: cluster 2021-01-27T16:42:19.465576+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:19.804 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:19 smithi106 bash[13484]: cluster 2021-01-27T16:42:19.465576+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:20.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:19 smithi094 bash[9811]: cluster 2021-01-27T16:42:19.465576+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:21.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:42:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2021-01-27T16:42:21.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:21 smithi106 bash[9795]: cluster 2021-01-27T16:42:21.466661+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:21.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:21 smithi106 bash[10032]: debug 2021-01-27T16:42:21.671+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:21.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:21 smithi106 bash[13484]: cluster 2021-01-27T16:42:21.466661+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:22.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:21 smithi094 bash[9811]: cluster 2021-01-27T16:42:21.466661+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:22.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:22.776 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2021-01-27T16:42:21.465872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1259,"num_read_kb":759,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":2849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51164,"kb_used_data":6876,"kb_used_omap":0,"kb_used_meta":44224,"kb_avail":749910052,"statfs":{"total":767960285184,"available":767907893248,"internally_reserved":0,"allocated":7041024,"data_stored":2308078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45285376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006712"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378220+0000","last_change":"2021-01-27T16:39:30.470066+0000","last_active":"2021-01-27T16:40:25.378220+0000","last_peered":"2021-01-27T16:40:25.378220+0000","last_clean":"2021-01-27T16:40:25.378220+0000","last_became_active":"2021-01-27T16:39:30.468804+0000","last_became_peered":"2021-01-27T16:39:30.468804+0000","last_unstale":"2021-01-27T16:40:25.378220+0000","last_undegraded":"2021-01-27T16:40:25.378220+0000","last_fullsized":"2021-01-27T16:40:25.378220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368739+0000","last_change":"2021-01-27T16:39:27.338452+0000","last_active":"2021-01-27T16:40:25.368739+0000","last_peered":"2021-01-27T16:40:25.368739+0000","last_clean":"2021-01-27T16:40:25.368739+0000","last_became_active":"2021-01-27T16:39:27.338029+0000","last_became_peered":"2021-01-27T16:39:27.338029+0000","last_unstale":"2021-01-27T16:40:25.368739+0000","last_undegraded":"2021-01-27T16:40:25.368739+0000","last_fullsized":"2021-01-27T16:40:25.368739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"45'1","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387242+0000","last_change":"2021-01-27T16:39:08.702567+0000","last_active":"2021-01-27T16:40:25.387242+0000","last_peered":"2021-01-27T16:40:25.387242+0000","last_clean":"2021-01-27T16:40:25.387242+0000","last_became_active":"2021-01-27T16:39:08.601354+0000","last_became_peered":"2021-01-27T16:39:08.601354+0000","last_unstale":"2021-01-27T16:40:25.387242+0000","last_undegraded":"2021-01-27T16:40:25.387242+0000","last_fullsized":"2021-01-27T16:40:25.387242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"59'20","reported_seq":"53","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378089+0000","last_change":"2021-01-27T16:39:25.312530+0000","last_active":"2021-01-27T16:40:25.378089+0000","last_peered":"2021-01-27T16:40:25.378089+0000","last_clean":"2021-01-27T16:40:25.378089+0000","last_became_active":"2021-01-27T16:39:25.311697+0000","last_became_peered":"2021-01-27T16:39:25.311697+0000","last_unstale":"2021-01-27T16:40:25.378089+0000","last_undegraded":"2021-01-27T16:40:25.378089+0000","last_fullsized":"2021-01-27T16:40:25.378089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369501+0000","last_change":"2021-01-27T16:39:30.352287+0000","last_active":"2021-01-27T16:40:25.369501+0000","last_peered":"2021-01-27T16:40:25.369501+0000","last_clean":"2021-01-27T16:40:25.369501+0000","last_became_active":"2021-01-27T16:39:30.351891+0000","last_became_peered":"2021-01-27T16:39:30.351891+0000","last_unstale":"2021-01-27T16:40:25.369501+0000","last_undegraded":"2021-01-27T16:40:25.369501+0000","last_fullsized":"2021-01-27T16:40:25.369501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378267+0000","last_change":"2021-01-27T16:39:27.334576+0000","last_active":"2021-01-27T16:40:25.378267+0000","last_peered":"2021-01-27T16:40:25.378267+0000","last_clean":"2021-01-27T16:40:25.378267+0000","last_became_active":"2021-01-27T16:39:27.334141+0000","last_became_peered":"2021-01-27T16:39:27.334141+0000","last_unstale":"2021-01-27T16:40:25.378267+0000","last_undegraded":"2021-01-27T16:40:25.378267+0000","last_fullsized":"2021-01-27T16:40:25.378267+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380053+0000","last_change":"2021-01-27T16:39:04.566184+0000","last_active":"2021-01-27T16:40:25.380053+0000","last_peered":"2021-01-27T16:40:25.380053+0000","last_clean":"2021-01-27T16:40:25.380053+0000","last_became_active":"2021-01-27T16:39:04.565712+0000","last_became_peered":"2021-01-27T16:39:04.565712+0000","last_unstale":"2021-01-27T16:40:25.380053+0000","last_undegraded":"2021-01-27T16:40:25.380053+0000","last_fullsized":"2021-01-27T16:40:25.380053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"59'15","reported_seq":"46","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369070+0000","last_change":"2021-01-27T16:39:25.313156+0000","last_active":"2021-01-27T16:40:25.369070+0000","last_peered":"2021-01-27T16:40:25.369070+0000","last_clean":"2021-01-27T16:40:25.369070+0000","last_became_active":"2021-01-27T16:39:25.312611+0000","last_became_peered":"2021-01-27T16:39:25.312611+0000","last_unstale":"2021-01-27T16:40:25.369070+0000","last_undegraded":"2021-01-27T16:40:25.369070+0000","last_fullsized":"2021-01-27T16:40:25.369070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370301+0000","last_change":"2021-01-27T16:39:30.341596+0000","last_active":"2021-01-27T16:40:25.370301+0000","last_peered":"2021-01-27T16:40:25.370301+0000","last_clean":"2021-01-27T16:40:25.370301+0000","last_became_active":"2021-01-27T16:39:30.341165+0000","last_became_peered":"2021-01-27T16:39:30.341165+0000","last_unstale":"2021-01-27T16:40:25.370301+0000","last_undegraded":"2021-01-27T16:40:25.370301+0000","last_fullsized":"2021-01-27T16:40:25.370301+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388436+0000","last_change":"2021-01-27T16:39:27.343024+0000","last_active":"2021-01-27T16:40:25.388436+0000","last_peered":"2021-01-27T16:40:25.388436+0000","last_clean":"2021-01-27T16:40:25.388436+0000","last_became_active":"2021-01-27T16:39:27.342525+0000","last_became_peered":"2021-01-27T16:39:27.342525+0000","last_unstale":"2021-01-27T16:40:25.388436+0000","last_undegraded":"2021-01-27T16:40:25.388436+0000","last_fullsized":"2021-01-27T16:40:25.388436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389547+0000","last_change":"2021-01-27T16:39:08.603276+0000","last_active":"2021-01-27T16:40:25.389547+0000","last_peered":"2021-01-27T16:40:25.389547+0000","last_clean":"2021-01-27T16:40:25.389547+0000","last_became_active":"2021-01-27T16:39:08.600792+0000","last_became_peered":"2021-01-27T16:39:08.600792+0000","last_unstale":"2021-01-27T16:40:25.389547+0000","last_undegraded":"2021-01-27T16:40:25.389547+0000","last_fullsized":"2021-01-27T16:40:25.389547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"59'6","reported_seq":"30","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369780+0000","last_change":"2021-01-27T16:39:25.315715+0000","last_active":"2021-01-27T16:40:25.369780+0000","last_peered":"2021-01-27T16:40:25.369780+0000","last_clean":"2021-01-27T16:40:25.369780+0000","last_became_active":"2021-01-27T16:39:25.315191+0000","last_became_peered":"2021-01-27T16:39:25.315191+0000","last_unstale":"2021-01-27T16:40:25.369780+0000","last_undegraded":"2021-01-27T16:40:25.369780+0000","last_fullsized":"2021-01-27T16:40:25.369780+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386898+0000","last_change":"2021-01-27T16:39:30.344754+0000","last_active":"2021-01-27T16:40:25.386898+0000","last_peered":"2021-01-27T16:40:25.386898+0000","last_clean":"2021-01-27T16:40:25.386898+0000","last_became_active":"2021-01-27T16:39:30.343877+0000","last_became_peered":"2021-01-27T16:39:30.343877+0000","last_unstale":"2021-01-27T16:40:25.386898+0000","last_undegraded":"2021-01-27T16:40:25.386898+0000","last_fullsized":"2021-01-27T16:40:25.386898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371105+0000","last_change":"2021-01-27T16:39:27.331838+0000","last_active":"2021-01-27T16:40:25.371105+0000","last_peered":"2021-01-27T16:40:25.371105+0000","last_clean":"2021-01-27T16:40:25.371105+0000","last_became_active":"2021-01-27T16:39:27.331381+0000","last_became_peered":"2021-01-27T16:39:27.331381+0000","last_unstale":"2021-01-27T16:40:25.371105+0000","last_undegraded":"2021-01-27T16:40:25.371105+0000","last_fullsized":"2021-01-27T16:40:25.371105+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389247+0000","last_change":"2021-01-27T16:39:08.598987+0000","last_active":"2021-01-27T16:40:25.389247+0000","last_peered":"2021-01-27T16:40:25.389247+0000","last_clean":"2021-01-27T16:40:25.389247+0000","last_became_active":"2021-01-27T16:39:08.598511+0000","last_became_peered":"2021-01-27T16:39:08.598511+0000","last_unstale":"2021-01-27T16:40:25.389247+0000","last_undegraded":"2021-01-27T16:40:25.389247+0000","last_fullsized":"2021-01-27T16:40:25.389247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"59'13","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369638+0000","last_change":"2021-01-27T16:39:25.314193+0000","last_active":"2021-01-27T16:40:25.369638+0000","last_peered":"2021-01-27T16:40:25.369638+0000","last_clean":"2021-01-27T16:40:25.369638+0000","last_became_active":"2021-01-27T16:39:25.313757+0000","last_became_peered":"2021-01-27T16:39:25.313757+0000","last_unstale":"2021-01-27T16:40:25.369638+0000","last_undegraded":"2021-01-27T16:40:25.369638+0000","last_fullsized":"2021-01-27T16:40:25.369638+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377776+0000","last_change":"2021-01-27T16:39:30.469614+0000","last_active":"2021-01-27T16:40:25.377776+0000","last_peered":"2021-01-27T16:40:25.377776+0000","last_clean":"2021-01-27T16:40:25.377776+0000","last_became_active":"2021-01-27T16:39:30.463066+0000","last_became_peered":"2021-01-27T16:39:30.463066+0000","last_unstale":"2021-01-27T16:40:25.377776+0000","last_undegraded":"2021-01-27T16:40:25.377776+0000","last_fullsized":"2021-01-27T16:40:25.377776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370667+0000","last_change":"2021-01-27T16:39:27.329920+0000","last_active":"2021-01-27T16:40:25.370667+0000","last_peered":"2021-01-27T16:40:25.370667+0000","last_clean":"2021-01-27T16:40:25.370667+0000","last_became_active":"2021-01-27T16:39:27.329539+0000","last_became_peered":"2021-01-27T16:39:27.329539+0000","last_unstale":"2021-01-27T16:40:25.370667+0000","last_undegraded":"2021-01-27T16:40:25.370667+0000","last_fullsized":"2021-01-27T16:40:25.370667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378301+0000","last_change":"2021-01-27T16:39:08.594067+0000","last_active":"2021-01-27T16:40:25.378301+0000","last_peered":"2021-01-27T16:40:25.378301+0000","last_clean":"2021-01-27T16:40:25.378301+0000","last_became_active":"2021-01-27T16:39:08.593660+0000","last_became_peered":"2021-01-27T16:39:08.593660+0000","last_unstale":"2021-01-27T16:40:25.378301+0000","last_undegraded":"2021-01-27T16:40:25.378301+0000","last_fullsized":"2021-01-27T16:40:25.378301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'16","reported_seq":"78","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.813469+0000","last_change":"2021-01-27T16:40:26.813469+0000","last_active":"2021-01-27T16:40:26.813469+0000","last_peered":"2021-01-27T16:40:26.813469+0000","last_clean":"2021-01-27T16:40:26.813469+0000","last_became_active":"2021-01-27T16:40:26.380690+0000","last_became_peered":"2021-01-27T16:40:26.380690+0000","last_unstale":"2021-01-27T16:40:26.813469+0000","last_undegraded":"2021-01-27T16:40:26.813469+0000","last_fullsized":"2021-01-27T16:40:26.813469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371499+0000","last_change":"2021-01-27T16:39:30.464556+0000","last_active":"2021-01-27T16:40:25.371499+0000","last_peered":"2021-01-27T16:40:25.371499+0000","last_clean":"2021-01-27T16:40:25.371499+0000","last_became_active":"2021-01-27T16:39:30.463929+0000","last_became_peered":"2021-01-27T16:39:30.463929+0000","last_unstale":"2021-01-27T16:40:25.371499+0000","last_undegraded":"2021-01-27T16:40:25.371499+0000","last_fullsized":"2021-01-27T16:40:25.371499+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379563+0000","last_change":"2021-01-27T16:39:27.343815+0000","last_active":"2021-01-27T16:40:25.379563+0000","last_peered":"2021-01-27T16:40:25.379563+0000","last_clean":"2021-01-27T16:40:25.379563+0000","last_became_active":"2021-01-27T16:39:27.343434+0000","last_became_peered":"2021-01-27T16:39:27.343434+0000","last_unstale":"2021-01-27T16:40:25.379563+0000","last_undegraded":"2021-01-27T16:40:25.379563+0000","last_fullsized":"2021-01-27T16:40:25.379563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368445+0000","last_change":"2021-01-27T16:39:08.595089+0000","last_active":"2021-01-27T16:40:25.368445+0000","last_peered":"2021-01-27T16:40:25.368445+0000","last_clean":"2021-01-27T16:40:25.368445+0000","last_became_active":"2021-01-27T16:39:08.594293+0000","last_became_peered":"2021-01-27T16:39:08.594293+0000","last_unstale":"2021-01-27T16:40:25.368445+0000","last_undegraded":"2021-01-27T16:40:25.368445+0000","last_fullsized":"2021-01-27T16:40:25.368445+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"59'15","reported_seq":"43","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379783+0000","last_change":"2021-01-27T16:39:25.315044+0000","last_active":"2021-01-27T16:40:25.379783+0000","last_peered":"2021-01-27T16:40:25.379783+0000","last_clean":"2021-01-27T16:40:25.379783+0000","last_became_active":"2021-01-27T16:39:25.314084+0000","last_became_peered":"2021-01-27T16:39:25.314084+0000","last_unstale":"2021-01-27T16:40:25.379783+0000","last_undegraded":"2021-01-27T16:40:25.379783+0000","last_fullsized":"2021-01-27T16:40:25.379783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378939+0000","last_change":"2021-01-27T16:39:30.342981+0000","last_active":"2021-01-27T16:40:25.378939+0000","last_peered":"2021-01-27T16:40:25.378939+0000","last_clean":"2021-01-27T16:40:25.378939+0000","last_became_active":"2021-01-27T16:39:30.342603+0000","last_became_peered":"2021-01-27T16:39:30.342603+0000","last_unstale":"2021-01-27T16:40:25.378939+0000","last_undegraded":"2021-01-27T16:40:25.378939+0000","last_fullsized":"2021-01-27T16:40:25.378939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387478+0000","last_change":"2021-01-27T16:39:27.340214+0000","last_active":"2021-01-27T16:40:25.387478+0000","last_peered":"2021-01-27T16:40:25.387478+0000","last_clean":"2021-01-27T16:40:25.387478+0000","last_became_active":"2021-01-27T16:39:27.339696+0000","last_became_peered":"2021-01-27T16:39:27.339696+0000","last_unstale":"2021-01-27T16:40:25.387478+0000","last_undegraded":"2021-01-27T16:40:25.387478+0000","last_fullsized":"2021-01-27T16:40:25.387478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377586+0000","last_change":"2021-01-27T16:39:04.565598+0000","last_active":"2021-01-27T16:40:25.377586+0000","last_peered":"2021-01-27T16:40:25.377586+0000","last_clean":"2021-01-27T16:40:25.377586+0000","last_became_active":"2021-01-27T16:39:04.565126+0000","last_became_peered":"2021-01-27T16:39:04.565126+0000","last_unstale":"2021-01-27T16:40:25.377586+0000","last_undegraded":"2021-01-27T16:40:25.377586+0000","last_fullsized":"2021-01-27T16:40:25.377586+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"59'17","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369391+0000","last_change":"2021-01-27T16:39:25.316721+0000","last_active":"2021-01-27T16:40:25.369391+0000","last_peered":"2021-01-27T16:40:25.369391+0000","last_clean":"2021-01-27T16:40:25.369391+0000","last_became_active":"2021-01-27T16:39:25.316275+0000","last_became_peered":"2021-01-27T16:39:25.316275+0000","last_unstale":"2021-01-27T16:40:25.369391+0000","last_undegraded":"2021-01-27T16:40:25.369391+0000","last_fullsized":"2021-01-27T16:40:25.369391+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389554+0000","last_change":"2021-01-27T16:39:30.337510+0000","last_active":"2021-01-27T16:40:25.389554+0000","last_peered":"2021-01-27T16:40:25.389554+0000","last_clean":"2021-01-27T16:40:25.389554+0000","last_became_active":"2021-01-27T16:39:30.337051+0000","last_became_peered":"2021-01-27T16:39:30.337051+0000","last_unstale":"2021-01-27T16:40:25.389554+0000","last_undegraded":"2021-01-27T16:40:25.389554+0000","last_fullsized":"2021-01-27T16:40:25.389554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"54'2","reported_seq":"52","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:08.338546+0000","last_change":"2021-01-27T16:39:27.333271+0000","last_active":"2021-01-27T16:42:08.338546+0000","last_peered":"2021-01-27T16:42:08.338546+0000","last_clean":"2021-01-27T16:42:08.338546+0000","last_became_active":"2021-01-27T16:39:27.331940+0000","last_became_peered":"2021-01-27T16:39:27.331940+0000","last_unstale":"2021-01-27T16:42:08.338546+0000","last_undegraded":"2021-01-27T16:42:08.338546+0000","last_fullsized":"2021-01-27T16:42:08.338546+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369996+0000","last_change":"2021-01-27T16:39:08.594952+0000","last_active":"2021-01-27T16:40:25.369996+0000","last_peered":"2021-01-27T16:40:25.369996+0000","last_clean":"2021-01-27T16:40:25.369996+0000","last_became_active":"2021-01-27T16:39:08.594087+0000","last_became_peered":"2021-01-27T16:39:08.594087+0000","last_unstale":"2021-01-27T16:40:25.369996+0000","last_undegraded":"2021-01-27T16:40:25.369996+0000","last_fullsized":"2021-01-27T16:40:25.369996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"59'16","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387393+0000","last_change":"2021-01-27T16:39:25.775439+0000","last_active":"2021-01-27T16:40:25.387393+0000","last_peered":"2021-01-27T16:40:25.387393+0000","last_clean":"2021-01-27T16:40:25.387393+0000","last_became_active":"2021-01-27T16:39:25.774705+0000","last_became_peered":"2021-01-27T16:39:25.774705+0000","last_unstale":"2021-01-27T16:40:25.387393+0000","last_undegraded":"2021-01-27T16:40:25.387393+0000","last_fullsized":"2021-01-27T16:40:25.387393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378666+0000","last_change":"2021-01-27T16:39:30.466847+0000","last_active":"2021-01-27T16:40:25.378666+0000","last_peered":"2021-01-27T16:40:25.378666+0000","last_clean":"2021-01-27T16:40:25.378666+0000","last_became_active":"2021-01-27T16:39:30.464291+0000","last_became_peered":"2021-01-27T16:39:30.464291+0000","last_unstale":"2021-01-27T16:40:25.378666+0000","last_undegraded":"2021-01-27T16:40:25.378666+0000","last_fullsized":"2021-01-27T16:40:25.378666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388477+0000","last_change":"2021-01-27T16:39:27.342649+0000","last_active":"2021-01-27T16:40:25.388477+0000","last_peered":"2021-01-27T16:40:25.388477+0000","last_clean":"2021-01-27T16:40:25.388477+0000","last_became_active":"2021-01-27T16:39:27.341991+0000","last_became_peered":"2021-01-27T16:39:27.341991+0000","last_unstale":"2021-01-27T16:40:25.388477+0000","last_undegraded":"2021-01-27T16:40:25.388477+0000","last_fullsized":"2021-01-27T16:40:25.388477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'3","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369512+0000","last_change":"2021-01-27T16:39:07.783274+0000","last_active":"2021-01-27T16:40:25.369512+0000","last_peered":"2021-01-27T16:40:25.369512+0000","last_clean":"2021-01-27T16:40:25.369512+0000","last_became_active":"2021-01-27T16:39:07.589253+0000","last_became_peered":"2021-01-27T16:39:07.589253+0000","last_unstale":"2021-01-27T16:40:25.369512+0000","last_undegraded":"2021-01-27T16:40:25.369512+0000","last_fullsized":"2021-01-27T16:40:25.369512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'14","reported_seq":"43","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377983+0000","last_change":"2021-01-27T16:39:25.773006+0000","last_active":"2021-01-27T16:40:25.377983+0000","last_peered":"2021-01-27T16:40:25.377983+0000","last_clean":"2021-01-27T16:40:25.377983+0000","last_became_active":"2021-01-27T16:39:25.771745+0000","last_became_peered":"2021-01-27T16:39:25.771745+0000","last_unstale":"2021-01-27T16:40:25.377983+0000","last_undegraded":"2021-01-27T16:40:25.377983+0000","last_fullsized":"2021-01-27T16:40:25.377983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388186+0000","last_change":"2021-01-27T16:39:30.337576+0000","last_active":"2021-01-27T16:40:25.388186+0000","last_peered":"2021-01-27T16:40:25.388186+0000","last_clean":"2021-01-27T16:40:25.388186+0000","last_became_active":"2021-01-27T16:39:30.337039+0000","last_became_peered":"2021-01-27T16:39:30.337039+0000","last_unstale":"2021-01-27T16:40:25.388186+0000","last_undegraded":"2021-01-27T16:40:25.388186+0000","last_fullsized":"2021-01-27T16:40:25.388186+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368226+0000","last_change":"2021-01-27T16:39:27.331890+0000","last_active":"2021-01-27T16:40:25.368226+0000","last_peered":"2021-01-27T16:40:25.368226+0000","last_clean":"2021-01-27T16:40:25.368226+0000","last_became_active":"2021-01-27T16:39:27.331383+0000","last_became_peered":"2021-01-27T16:39:27.331383+0000","last_unstale":"2021-01-27T16:40:25.368226+0000","last_undegraded":"2021-01-27T16:40:25.368226+0000","last_fullsized":"2021-01-27T16:40:25.368226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374289+0000","last_change":"2021-01-27T16:39:04.558104+0000","last_active":"2021-01-27T16:40:25.374289+0000","last_peered":"2021-01-27T16:40:25.374289+0000","last_clean":"2021-01-27T16:40:25.374289+0000","last_became_active":"2021-01-27T16:39:04.557713+0000","last_became_peered":"2021-01-27T16:39:04.557713+0000","last_unstale":"2021-01-27T16:40:25.374289+0000","last_undegraded":"2021-01-27T16:40:25.374289+0000","last_fullsized":"2021-01-27T16:40:25.374289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"59'12","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377401+0000","last_change":"2021-01-27T16:39:25.322950+0000","last_active":"2021-01-27T16:40:25.377401+0000","last_peered":"2021-01-27T16:40:25.377401+0000","last_clean":"2021-01-27T16:40:25.377401+0000","last_became_active":"2021-01-27T16:39:25.322683+0000","last_became_peered":"2021-01-27T16:39:25.322683+0000","last_unstale":"2021-01-27T16:40:25.377401+0000","last_undegraded":"2021-01-27T16:40:25.377401+0000","last_fullsized":"2021-01-27T16:40:25.377401+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377369+0000","last_change":"2021-01-27T16:39:30.353494+0000","last_active":"2021-01-27T16:40:25.377369+0000","last_peered":"2021-01-27T16:40:25.377369+0000","last_clean":"2021-01-27T16:40:25.377369+0000","last_became_active":"2021-01-27T16:39:30.353102+0000","last_became_peered":"2021-01-27T16:39:30.353102+0000","last_unstale":"2021-01-27T16:40:25.377369+0000","last_undegraded":"2021-01-27T16:40:25.377369+0000","last_fullsized":"2021-01-27T16:40:25.377369+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378997+0000","last_change":"2021-01-27T16:39:27.335611+0000","last_active":"2021-01-27T16:40:25.378997+0000","last_peered":"2021-01-27T16:40:25.378997+0000","last_clean":"2021-01-27T16:40:25.378997+0000","last_became_active":"2021-01-27T16:39:27.335157+0000","last_became_peered":"2021-01-27T16:39:27.335157+0000","last_unstale":"2021-01-27T16:40:25.378997+0000","last_undegraded":"2021-01-27T16:40:25.378997+0000","last_fullsized":"2021-01-27T16:40:25.378997+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"45'1","reported_seq":"27","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379176+0000","last_change":"2021-01-27T16:39:04.570724+0000","last_active":"2021-01-27T16:40:25.379176+0000","last_peered":"2021-01-27T16:40:25.379176+0000","last_clean":"2021-01-27T16:40:25.379176+0000","last_became_active":"2021-01-27T16:39:04.570339+0000","last_became_peered":"2021-01-27T16:39:04.570339+0000","last_unstale":"2021-01-27T16:40:25.379176+0000","last_undegraded":"2021-01-27T16:40:25.379176+0000","last_fullsized":"2021-01-27T16:40:25.379176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"59'15","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370023+0000","last_change":"2021-01-27T16:39:25.312882+0000","last_active":"2021-01-27T16:40:25.370023+0000","last_peered":"2021-01-27T16:40:25.370023+0000","last_clean":"2021-01-27T16:40:25.370023+0000","last_became_active":"2021-01-27T16:39:25.312440+0000","last_became_peered":"2021-01-27T16:39:25.312440+0000","last_unstale":"2021-01-27T16:40:25.370023+0000","last_undegraded":"2021-01-27T16:40:25.370023+0000","last_fullsized":"2021-01-27T16:40:25.370023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385861+0000","last_change":"2021-01-27T16:39:30.352345+0000","last_active":"2021-01-27T16:40:25.385861+0000","last_peered":"2021-01-27T16:40:25.385861+0000","last_clean":"2021-01-27T16:40:25.385861+0000","last_became_active":"2021-01-27T16:39:30.351397+0000","last_became_peered":"2021-01-27T16:39:30.351397+0000","last_unstale":"2021-01-27T16:40:25.385861+0000","last_undegraded":"2021-01-27T16:40:25.385861+0000","last_fullsized":"2021-01-27T16:40:25.385861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378500+0000","last_change":"2021-01-27T16:39:27.337834+0000","last_active":"2021-01-27T16:40:25.378500+0000","last_peered":"2021-01-27T16:40:25.378500+0000","last_clean":"2021-01-27T16:40:25.378500+0000","last_became_active":"2021-01-27T16:39:27.337546+0000","last_became_peered":"2021-01-27T16:39:27.337546+0000","last_unstale":"2021-01-27T16:40:25.378500+0000","last_undegraded":"2021-01-27T16:40:25.378500+0000","last_fullsized":"2021-01-27T16:40:25.378500+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369065+0000","last_change":"2021-01-27T16:39:04.551936+0000","last_active":"2021-01-27T16:40:25.369065+0000","last_peered":"2021-01-27T16:40:25.369065+0000","last_clean":"2021-01-27T16:40:25.369065+0000","last_became_active":"2021-01-27T16:39:04.550706+0000","last_became_peered":"2021-01-27T16:39:04.550706+0000","last_unstale":"2021-01-27T16:40:25.369065+0000","last_undegraded":"2021-01-27T16:40:25.369065+0000","last_fullsized":"2021-01-27T16:40:25.369065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"59'15","reported_seq":"46","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378752+0000","last_change":"2021-01-27T16:39:25.313876+0000","last_active":"2021-01-27T16:40:25.378752+0000","last_peered":"2021-01-27T16:40:25.378752+0000","last_clean":"2021-01-27T16:40:25.378752+0000","last_became_active":"2021-01-27T16:39:25.313506+0000","last_became_peered":"2021-01-27T16:39:25.313506+0000","last_unstale":"2021-01-27T16:40:25.378752+0000","last_undegraded":"2021-01-27T16:40:25.378752+0000","last_fullsized":"2021-01-27T16:40:25.378752+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371423+0000","last_change":"2021-01-27T16:39:30.341986+0000","last_active":"2021-01-27T16:40:25.371423+0000","last_peered":"2021-01-27T16:40:25.371423+0000","last_clean":"2021-01-27T16:40:25.371423+0000","last_became_active":"2021-01-27T16:39:30.341553+0000","last_became_peered":"2021-01-27T16:39:30.341553+0000","last_unstale":"2021-01-27T16:40:25.371423+0000","last_undegraded":"2021-01-27T16:40:25.371423+0000","last_fullsized":"2021-01-27T16:40:25.371423+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340348+0000","last_change":"2021-01-27T16:39:27.331142+0000","last_active":"2021-01-27T16:42:13.340348+0000","last_peered":"2021-01-27T16:42:13.340348+0000","last_clean":"2021-01-27T16:42:13.340348+0000","last_became_active":"2021-01-27T16:39:27.330561+0000","last_became_peered":"2021-01-27T16:39:27.330561+0000","last_unstale":"2021-01-27T16:42:13.340348+0000","last_undegraded":"2021-01-27T16:42:13.340348+0000","last_fullsized":"2021-01-27T16:42:13.340348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386564+0000","last_change":"2021-01-27T16:39:04.573517+0000","last_active":"2021-01-27T16:40:25.386564+0000","last_peered":"2021-01-27T16:40:25.386564+0000","last_clean":"2021-01-27T16:40:25.386564+0000","last_became_active":"2021-01-27T16:39:04.573056+0000","last_became_peered":"2021-01-27T16:39:04.573056+0000","last_unstale":"2021-01-27T16:40:25.386564+0000","last_undegraded":"2021-01-27T16:40:25.386564+0000","last_fullsized":"2021-01-27T16:40:25.386564+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"59'13","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373611+0000","last_change":"2021-01-27T16:39:25.775397+0000","last_active":"2021-01-27T16:40:25.373611+0000","last_peered":"2021-01-27T16:40:25.373611+0000","last_clean":"2021-01-27T16:40:25.373611+0000","last_became_active":"2021-01-27T16:39:25.774995+0000","last_became_peered":"2021-01-27T16:39:25.774995+0000","last_unstale":"2021-01-27T16:40:25.373611+0000","last_undegraded":"2021-01-27T16:40:25.373611+0000","last_fullsized":"2021-01-27T16:40:25.373611+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386482+0000","last_change":"2021-01-27T16:39:30.351394+0000","last_active":"2021-01-27T16:40:25.386482+0000","last_peered":"2021-01-27T16:40:25.386482+0000","last_clean":"2021-01-27T16:40:25.386482+0000","last_became_active":"2021-01-27T16:39:30.350970+0000","last_became_peered":"2021-01-27T16:39:30.350970+0000","last_unstale":"2021-01-27T16:40:25.386482+0000","last_undegraded":"2021-01-27T16:40:25.386482+0000","last_fullsized":"2021-01-27T16:40:25.386482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.342250+0000","last_change":"2021-01-27T16:39:27.337005+0000","last_active":"2021-01-27T16:42:13.342250+0000","last_peered":"2021-01-27T16:42:13.342250+0000","last_clean":"2021-01-27T16:42:13.342250+0000","last_became_active":"2021-01-27T16:39:27.336523+0000","last_became_peered":"2021-01-27T16:39:27.336523+0000","last_unstale":"2021-01-27T16:42:13.342250+0000","last_undegraded":"2021-01-27T16:42:13.342250+0000","last_fullsized":"2021-01-27T16:42:13.342250+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370515+0000","last_change":"2021-01-27T16:39:08.653875+0000","last_active":"2021-01-27T16:40:25.370515+0000","last_peered":"2021-01-27T16:40:25.370515+0000","last_clean":"2021-01-27T16:40:25.370515+0000","last_became_active":"2021-01-27T16:39:08.595314+0000","last_became_peered":"2021-01-27T16:39:08.595314+0000","last_unstale":"2021-01-27T16:40:25.370515+0000","last_undegraded":"2021-01-27T16:40:25.370515+0000","last_fullsized":"2021-01-27T16:40:25.370515+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"59'14","reported_seq":"41","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378913+0000","last_change":"2021-01-27T16:39:25.772514+0000","last_active":"2021-01-27T16:40:25.378913+0000","last_peered":"2021-01-27T16:40:25.378913+0000","last_clean":"2021-01-27T16:40:25.378913+0000","last_became_active":"2021-01-27T16:39:25.771418+0000","last_became_peered":"2021-01-27T16:39:25.771418+0000","last_unstale":"2021-01-27T16:40:25.378913+0000","last_undegraded":"2021-01-27T16:40:25.378913+0000","last_fullsized":"2021-01-27T16:40:25.378913+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389393+0000","last_change":"2021-01-27T16:39:30.464170+0000","last_active":"2021-01-27T16:40:25.389393+0000","last_peered":"2021-01-27T16:40:25.389393+0000","last_clean":"2021-01-27T16:40:25.389393+0000","last_became_active":"2021-01-27T16:39:30.463773+0000","last_became_peered":"2021-01-27T16:39:30.463773+0000","last_unstale":"2021-01-27T16:40:25.389393+0000","last_undegraded":"2021-01-27T16:40:25.389393+0000","last_fullsized":"2021-01-27T16:40:25.389393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374244+0000","last_change":"2021-01-27T16:39:27.327942+0000","last_active":"2021-01-27T16:40:25.374244+0000","last_peered":"2021-01-27T16:40:25.374244+0000","last_clean":"2021-01-27T16:40:25.374244+0000","last_became_active":"2021-01-27T16:39:27.327519+0000","last_became_peered":"2021-01-27T16:39:27.327519+0000","last_unstale":"2021-01-27T16:40:25.374244+0000","last_undegraded":"2021-01-27T16:40:25.374244+0000","last_fullsized":"2021-01-27T16:40:25.374244+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"26","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368398+0000","last_change":"2021-01-27T16:39:04.551499+0000","last_active":"2021-01-27T16:40:25.368398+0000","last_peered":"2021-01-27T16:40:25.368398+0000","last_clean":"2021-01-27T16:40:25.368398+0000","last_became_active":"2021-01-27T16:39:04.551183+0000","last_became_peered":"2021-01-27T16:39:04.551183+0000","last_unstale":"2021-01-27T16:40:25.368398+0000","last_undegraded":"2021-01-27T16:40:25.368398+0000","last_fullsized":"2021-01-27T16:40:25.368398+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"59'7","reported_seq":"29","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377685+0000","last_change":"2021-01-27T16:39:25.772853+0000","last_active":"2021-01-27T16:40:25.377685+0000","last_peered":"2021-01-27T16:40:25.377685+0000","last_clean":"2021-01-27T16:40:25.377685+0000","last_became_active":"2021-01-27T16:39:25.771810+0000","last_became_peered":"2021-01-27T16:39:25.771810+0000","last_unstale":"2021-01-27T16:40:25.377685+0000","last_undegraded":"2021-01-27T16:40:25.377685+0000","last_fullsized":"2021-01-27T16:40:25.377685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379479+0000","last_change":"2021-01-27T16:39:30.342746+0000","last_active":"2021-01-27T16:40:25.379479+0000","last_peered":"2021-01-27T16:40:25.379479+0000","last_clean":"2021-01-27T16:40:25.379479+0000","last_became_active":"2021-01-27T16:39:30.342349+0000","last_became_peered":"2021-01-27T16:39:30.342349+0000","last_unstale":"2021-01-27T16:40:25.379479+0000","last_undegraded":"2021-01-27T16:40:25.379479+0000","last_fullsized":"2021-01-27T16:40:25.379479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377964+0000","last_change":"2021-01-27T16:39:27.339358+0000","last_active":"2021-01-27T16:40:25.377964+0000","last_peered":"2021-01-27T16:40:25.377964+0000","last_clean":"2021-01-27T16:40:25.377964+0000","last_became_active":"2021-01-27T16:39:27.338947+0000","last_became_peered":"2021-01-27T16:39:27.338947+0000","last_unstale":"2021-01-27T16:40:25.377964+0000","last_undegraded":"2021-01-27T16:40:25.377964+0000","last_fullsized":"2021-01-27T16:40:25.377964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"49'2","reported_seq":"28","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376625+0000","last_change":"2021-01-27T16:39:04.564492+0000","last_active":"2021-01-27T16:40:25.376625+0000","last_peered":"2021-01-27T16:40:25.376625+0000","last_clean":"2021-01-27T16:40:25.376625+0000","last_became_active":"2021-01-27T16:39:04.564060+0000","last_became_peered":"2021-01-27T16:39:04.564060+0000","last_unstale":"2021-01-27T16:40:25.376625+0000","last_undegraded":"2021-01-27T16:40:25.376625+0000","last_fullsized":"2021-01-27T16:40:25.376625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"59'16","reported_seq":"48","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387169+0000","last_change":"2021-01-27T16:39:25.775954+0000","last_active":"2021-01-27T16:40:25.387169+0000","last_peered":"2021-01-27T16:40:25.387169+0000","last_clean":"2021-01-27T16:40:25.387169+0000","last_became_active":"2021-01-27T16:39:25.775204+0000","last_became_peered":"2021-01-27T16:39:25.775204+0000","last_unstale":"2021-01-27T16:40:25.387169+0000","last_undegraded":"2021-01-27T16:40:25.387169+0000","last_fullsized":"2021-01-27T16:40:25.387169+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378586+0000","last_change":"2021-01-27T16:39:30.355162+0000","last_active":"2021-01-27T16:40:25.378586+0000","last_peered":"2021-01-27T16:40:25.378586+0000","last_clean":"2021-01-27T16:40:25.378586+0000","last_became_active":"2021-01-27T16:39:30.354840+0000","last_became_peered":"2021-01-27T16:39:30.354840+0000","last_unstale":"2021-01-27T16:40:25.378586+0000","last_undegraded":"2021-01-27T16:40:25.378586+0000","last_fullsized":"2021-01-27T16:40:25.378586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'2","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371686+0000","last_change":"2021-01-27T16:39:08.595414+0000","last_active":"2021-01-27T16:40:25.371686+0000","last_peered":"2021-01-27T16:40:25.371686+0000","last_clean":"2021-01-27T16:40:25.371686+0000","last_became_active":"2021-01-27T16:39:08.594999+0000","last_became_peered":"2021-01-27T16:39:08.594999+0000","last_unstale":"2021-01-27T16:40:25.371686+0000","last_undegraded":"2021-01-27T16:40:25.371686+0000","last_fullsized":"2021-01-27T16:40:25.371686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"59'15","reported_seq":"47","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369295+0000","last_change":"2021-01-27T16:39:25.316865+0000","last_active":"2021-01-27T16:40:25.369295+0000","last_peered":"2021-01-27T16:40:25.369295+0000","last_clean":"2021-01-27T16:40:25.369295+0000","last_became_active":"2021-01-27T16:39:25.316442+0000","last_became_peered":"2021-01-27T16:39:25.316442+0000","last_unstale":"2021-01-27T16:40:25.369295+0000","last_undegraded":"2021-01-27T16:40:25.369295+0000","last_fullsized":"2021-01-27T16:40:25.369295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376528+0000","last_change":"2021-01-27T16:39:27.331086+0000","last_active":"2021-01-27T16:40:25.376528+0000","last_peered":"2021-01-27T16:40:25.376528+0000","last_clean":"2021-01-27T16:40:25.376528+0000","last_became_active":"2021-01-27T16:39:27.330564+0000","last_became_peered":"2021-01-27T16:39:27.330564+0000","last_unstale":"2021-01-27T16:40:25.376528+0000","last_undegraded":"2021-01-27T16:40:25.376528+0000","last_fullsized":"2021-01-27T16:40:25.376528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385982+0000","last_change":"2021-01-27T16:39:30.350390+0000","last_active":"2021-01-27T16:40:25.385982+0000","last_peered":"2021-01-27T16:40:25.385982+0000","last_clean":"2021-01-27T16:40:25.385982+0000","last_became_active":"2021-01-27T16:39:30.349967+0000","last_became_peered":"2021-01-27T16:39:30.349967+0000","last_unstale":"2021-01-27T16:40:25.385982+0000","last_undegraded":"2021-01-27T16:40:25.385982+0000","last_fullsized":"2021-01-27T16:40:25.385982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.382066+0000","last_change":"2021-01-27T16:39:08.595257+0000","last_active":"2021-01-27T16:40:25.382066+0000","last_peered":"2021-01-27T16:40:25.382066+0000","last_clean":"2021-01-27T16:40:25.382066+0000","last_became_active":"2021-01-27T16:39:08.594542+0000","last_became_peered":"2021-01-27T16:39:08.594542+0000","last_unstale":"2021-01-27T16:40:25.382066+0000","last_undegraded":"2021-01-27T16:40:25.382066+0000","last_fullsized":"2021-01-27T16:40:25.382066+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'16","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378885+0000","last_change":"2021-01-27T16:39:25.312971+0000","last_active":"2021-01-27T16:40:25.378885+0000","last_peered":"2021-01-27T16:40:25.378885+0000","last_clean":"2021-01-27T16:40:25.378885+0000","last_became_active":"2021-01-27T16:39:25.310984+0000","last_became_peered":"2021-01-27T16:39:25.310984+0000","last_unstale":"2021-01-27T16:40:25.378885+0000","last_undegraded":"2021-01-27T16:40:25.378885+0000","last_fullsized":"2021-01-27T16:40:25.378885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":"52","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:08.336328+0000","last_change":"2021-01-27T16:39:27.333407+0000","last_active":"2021-01-27T16:42:08.336328+0000","last_peered":"2021-01-27T16:42:08.336328+0000","last_clean":"2021-01-27T16:42:08.336328+0000","last_became_active":"2021-01-27T16:39:27.332807+0000","last_became_peered":"2021-01-27T16:39:27.332807+0000","last_unstale":"2021-01-27T16:42:08.336328+0000","last_undegraded":"2021-01-27T16:42:08.336328+0000","last_fullsized":"2021-01-27T16:42:08.336328+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380109+0000","last_change":"2021-01-27T16:39:30.351940+0000","last_active":"2021-01-27T16:40:25.380109+0000","last_peered":"2021-01-27T16:40:25.380109+0000","last_clean":"2021-01-27T16:40:25.380109+0000","last_became_active":"2021-01-27T16:39:30.351552+0000","last_became_peered":"2021-01-27T16:39:30.351552+0000","last_unstale":"2021-01-27T16:40:25.380109+0000","last_undegraded":"2021-01-27T16:40:25.380109+0000","last_fullsized":"2021-01-27T16:40:25.380109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370625+0000","last_change":"2021-01-27T16:39:04.553471+0000","last_active":"2021-01-27T16:40:25.370625+0000","last_peered":"2021-01-27T16:40:25.370625+0000","last_clean":"2021-01-27T16:40:25.370625+0000","last_became_active":"2021-01-27T16:39:04.550623+0000","last_became_peered":"2021-01-27T16:39:04.550623+0000","last_unstale":"2021-01-27T16:40:25.370625+0000","last_undegraded":"2021-01-27T16:40:25.370625+0000","last_fullsized":"2021-01-27T16:40:25.370625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"59'25","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:28.080228+0000","last_change":"2021-01-27T16:40:28.080228+0000","last_active":"2021-01-27T16:40:28.080228+0000","last_peered":"2021-01-27T16:40:28.080228+0000","last_clean":"2021-01-27T16:40:28.080228+0000","last_became_active":"2021-01-27T16:40:26.387484+0000","last_became_peered":"2021-01-27T16:40:26.387484+0000","last_unstale":"2021-01-27T16:40:28.080228+0000","last_undegraded":"2021-01-27T16:40:28.080228+0000","last_fullsized":"2021-01-27T16:40:28.080228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386525+0000","last_change":"2021-01-27T16:39:27.341972+0000","last_active":"2021-01-27T16:40:25.386525+0000","last_peered":"2021-01-27T16:40:25.386525+0000","last_clean":"2021-01-27T16:40:25.386525+0000","last_became_active":"2021-01-27T16:39:27.341582+0000","last_became_peered":"2021-01-27T16:39:27.341582+0000","last_unstale":"2021-01-27T16:40:25.386525+0000","last_undegraded":"2021-01-27T16:40:25.386525+0000","last_fullsized":"2021-01-27T16:40:25.386525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389681+0000","last_change":"2021-01-27T16:39:30.465041+0000","last_active":"2021-01-27T16:40:25.389681+0000","last_peered":"2021-01-27T16:40:25.389681+0000","last_clean":"2021-01-27T16:40:25.389681+0000","last_became_active":"2021-01-27T16:39:30.463215+0000","last_became_peered":"2021-01-27T16:39:30.463215+0000","last_unstale":"2021-01-27T16:40:25.389681+0000","last_undegraded":"2021-01-27T16:40:25.389681+0000","last_fullsized":"2021-01-27T16:40:25.389681+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"59'5","reported_seq":"186","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:18.928184+0000","last_change":"2021-01-27T16:39:24.300166+0000","last_active":"2021-01-27T16:42:18.928184+0000","last_peered":"2021-01-27T16:42:18.928184+0000","last_clean":"2021-01-27T16:42:18.928184+0000","last_became_active":"2021-01-27T16:39:24.299781+0000","last_became_peered":"2021-01-27T16:39:24.299781+0000","last_unstale":"2021-01-27T16:42:18.928184+0000","last_undegraded":"2021-01-27T16:42:18.928184+0000","last_fullsized":"2021-01-27T16:42:18.928184+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":159,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"45'1","reported_seq":"28","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376932+0000","last_change":"2021-01-27T16:39:04.571835+0000","last_active":"2021-01-27T16:40:25.376932+0000","last_peered":"2021-01-27T16:40:25.376932+0000","last_clean":"2021-01-27T16:40:25.376932+0000","last_became_active":"2021-01-27T16:39:04.571379+0000","last_became_peered":"2021-01-27T16:39:04.571379+0000","last_unstale":"2021-01-27T16:40:25.376932+0000","last_undegraded":"2021-01-27T16:40:25.376932+0000","last_fullsized":"2021-01-27T16:40:25.376932+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"59'15","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379279+0000","last_change":"2021-01-27T16:39:25.309752+0000","last_active":"2021-01-27T16:40:25.379279+0000","last_peered":"2021-01-27T16:40:25.379279+0000","last_clean":"2021-01-27T16:40:25.379279+0000","last_became_active":"2021-01-27T16:39:25.309361+0000","last_became_peered":"2021-01-27T16:39:25.309361+0000","last_unstale":"2021-01-27T16:40:25.379279+0000","last_undegraded":"2021-01-27T16:40:25.379279+0000","last_fullsized":"2021-01-27T16:40:25.379279+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378482+0000","last_change":"2021-01-27T16:39:27.338731+0000","last_active":"2021-01-27T16:40:25.378482+0000","last_peered":"2021-01-27T16:40:25.378482+0000","last_clean":"2021-01-27T16:40:25.378482+0000","last_became_active":"2021-01-27T16:39:27.338189+0000","last_became_peered":"2021-01-27T16:39:27.338189+0000","last_unstale":"2021-01-27T16:40:25.378482+0000","last_undegraded":"2021-01-27T16:40:25.378482+0000","last_fullsized":"2021-01-27T16:40:25.378482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374079+0000","last_change":"2021-01-27T16:39:30.349530+0000","last_active":"2021-01-27T16:40:25.374079+0000","last_peered":"2021-01-27T16:40:25.374079+0000","last_clean":"2021-01-27T16:40:25.374079+0000","last_became_active":"2021-01-27T16:39:30.349110+0000","last_became_peered":"2021-01-27T16:39:30.349110+0000","last_unstale":"2021-01-27T16:40:25.374079+0000","last_undegraded":"2021-01-27T16:40:25.374079+0000","last_fullsized":"2021-01-27T16:40:25.374079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380251+0000","last_change":"2021-01-27T16:39:24.303331+0000","last_active":"2021-01-27T16:40:25.380251+0000","last_peered":"2021-01-27T16:40:25.380251+0000","last_clean":"2021-01-27T16:40:25.380251+0000","last_became_active":"2021-01-27T16:39:24.302844+0000","last_became_peered":"2021-01-27T16:39:24.302844+0000","last_unstale":"2021-01-27T16:40:25.380251+0000","last_undegraded":"2021-01-27T16:40:25.380251+0000","last_fullsized":"2021-01-27T16:40:25.380251+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"49'2","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.372943+0000","last_change":"2021-01-27T16:39:08.596240+0000","last_active":"2021-01-27T16:40:25.372943+0000","last_peered":"2021-01-27T16:40:25.372943+0000","last_clean":"2021-01-27T16:40:25.372943+0000","last_became_active":"2021-01-27T16:39:08.595001+0000","last_became_peered":"2021-01-27T16:39:08.595001+0000","last_unstale":"2021-01-27T16:40:25.372943+0000","last_undegraded":"2021-01-27T16:40:25.372943+0000","last_fullsized":"2021-01-27T16:40:25.372943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388298+0000","last_change":"2021-01-27T16:39:08.607545+0000","last_active":"2021-01-27T16:40:25.388298+0000","last_peered":"2021-01-27T16:40:25.388298+0000","last_clean":"2021-01-27T16:40:25.388298+0000","last_became_active":"2021-01-27T16:39:08.607230+0000","last_became_peered":"2021-01-27T16:39:08.607230+0000","last_unstale":"2021-01-27T16:40:25.388298+0000","last_undegraded":"2021-01-27T16:40:25.388298+0000","last_fullsized":"2021-01-27T16:40:25.388298+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:34:20.937701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:34:20.937701+0000","last_clean_scrub_stamp":"2021-01-27T16:34:20.937701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"59'15","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369657+0000","last_change":"2021-01-27T16:39:25.775168+0000","last_active":"2021-01-27T16:40:25.369657+0000","last_peered":"2021-01-27T16:40:25.369657+0000","last_clean":"2021-01-27T16:40:25.369657+0000","last_became_active":"2021-01-27T16:39:25.774575+0000","last_became_peered":"2021-01-27T16:39:25.774575+0000","last_unstale":"2021-01-27T16:40:25.369657+0000","last_undegraded":"2021-01-27T16:40:25.369657+0000","last_fullsized":"2021-01-27T16:40:25.369657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389376+0000","last_change":"2021-01-27T16:39:27.333511+0000","last_active":"2021-01-27T16:40:25.389376+0000","last_peered":"2021-01-27T16:40:25.389376+0000","last_clean":"2021-01-27T16:40:25.389376+0000","last_became_active":"2021-01-27T16:39:27.333080+0000","last_became_peered":"2021-01-27T16:39:27.333080+0000","last_unstale":"2021-01-27T16:40:25.389376+0000","last_undegraded":"2021-01-27T16:40:25.389376+0000","last_fullsized":"2021-01-27T16:40:25.389376+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381984+0000","last_change":"2021-01-27T16:39:30.349032+0000","last_active":"2021-01-27T16:40:25.381984+0000","last_peered":"2021-01-27T16:40:25.381984+0000","last_clean":"2021-01-27T16:40:25.381984+0000","last_became_active":"2021-01-27T16:39:30.348631+0000","last_became_peered":"2021-01-27T16:39:30.348631+0000","last_unstale":"2021-01-27T16:40:25.381984+0000","last_undegraded":"2021-01-27T16:40:25.381984+0000","last_fullsized":"2021-01-27T16:40:25.381984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386074+0000","last_change":"2021-01-27T16:39:24.305069+0000","last_active":"2021-01-27T16:40:25.386074+0000","last_peered":"2021-01-27T16:40:25.386074+0000","last_clean":"2021-01-27T16:40:25.386074+0000","last_became_active":"2021-01-27T16:39:24.304700+0000","last_became_peered":"2021-01-27T16:39:24.304700+0000","last_unstale":"2021-01-27T16:40:25.386074+0000","last_undegraded":"2021-01-27T16:40:25.386074+0000","last_fullsized":"2021-01-27T16:40:25.386074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"49'1","reported_seq":"14","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.386574+0000","last_change":"2021-01-27T16:40:26.386574+0000","last_active":"2021-01-27T16:40:26.386574+0000","last_peered":"2021-01-27T16:40:26.386574+0000","last_clean":"2021-01-27T16:40:26.386574+0000","last_became_active":"2021-01-27T16:40:26.380985+0000","last_became_peered":"2021-01-27T16:40:26.380985+0000","last_unstale":"2021-01-27T16:40:26.386574+0000","last_undegraded":"2021-01-27T16:40:26.386574+0000","last_fullsized":"2021-01-27T16:40:26.386574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"59'16","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387066+0000","last_change":"2021-01-27T16:39:25.311555+0000","last_active":"2021-01-27T16:40:25.387066+0000","last_peered":"2021-01-27T16:40:25.387066+0000","last_clean":"2021-01-27T16:40:25.387066+0000","last_became_active":"2021-01-27T16:39:25.311153+0000","last_became_peered":"2021-01-27T16:39:25.311153+0000","last_unstale":"2021-01-27T16:40:25.387066+0000","last_undegraded":"2021-01-27T16:40:25.387066+0000","last_fullsized":"2021-01-27T16:40:25.387066+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374029+0000","last_change":"2021-01-27T16:39:27.331577+0000","last_active":"2021-01-27T16:40:25.374029+0000","last_peered":"2021-01-27T16:40:25.374029+0000","last_clean":"2021-01-27T16:40:25.374029+0000","last_became_active":"2021-01-27T16:39:27.331172+0000","last_became_peered":"2021-01-27T16:39:27.331172+0000","last_unstale":"2021-01-27T16:40:25.374029+0000","last_undegraded":"2021-01-27T16:40:25.374029+0000","last_fullsized":"2021-01-27T16:40:25.374029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378185+0000","last_change":"2021-01-27T16:39:30.465615+0000","last_active":"2021-01-27T16:40:25.378185+0000","last_peered":"2021-01-27T16:40:25.378185+0000","last_clean":"2021-01-27T16:40:25.378185+0000","last_became_active":"2021-01-27T16:39:30.464407+0000","last_became_peered":"2021-01-27T16:39:30.464407+0000","last_unstale":"2021-01-27T16:40:25.378185+0000","last_undegraded":"2021-01-27T16:40:25.378185+0000","last_fullsized":"2021-01-27T16:40:25.378185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389473+0000","last_change":"2021-01-27T16:39:08.601875+0000","last_active":"2021-01-27T16:40:25.389473+0000","last_peered":"2021-01-27T16:40:25.389473+0000","last_clean":"2021-01-27T16:40:25.389473+0000","last_became_active":"2021-01-27T16:39:08.601381+0000","last_became_peered":"2021-01-27T16:39:08.601381+0000","last_unstale":"2021-01-27T16:40:25.389473+0000","last_undegraded":"2021-01-27T16:40:25.389473+0000","last_fullsized":"2021-01-27T16:40:25.389473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"59'21","reported_seq":"58","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386319+0000","last_change":"2021-01-27T16:39:25.772557+0000","last_active":"2021-01-27T16:40:25.386319+0000","last_peered":"2021-01-27T16:40:25.386319+0000","last_clean":"2021-01-27T16:40:25.386319+0000","last_became_active":"2021-01-27T16:39:25.771666+0000","last_became_peered":"2021-01-27T16:39:25.771666+0000","last_unstale":"2021-01-27T16:40:25.386319+0000","last_undegraded":"2021-01-27T16:40:25.386319+0000","last_fullsized":"2021-01-27T16:40:25.386319+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368336+0000","last_change":"2021-01-27T16:39:27.328927+0000","last_active":"2021-01-27T16:40:25.368336+0000","last_peered":"2021-01-27T16:40:25.368336+0000","last_clean":"2021-01-27T16:40:25.368336+0000","last_became_active":"2021-01-27T16:39:27.328402+0000","last_became_peered":"2021-01-27T16:39:27.328402+0000","last_unstale":"2021-01-27T16:40:25.368336+0000","last_undegraded":"2021-01-27T16:40:25.368336+0000","last_fullsized":"2021-01-27T16:40:25.368336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370092+0000","last_change":"2021-01-27T16:39:30.342418+0000","last_active":"2021-01-27T16:40:25.370092+0000","last_peered":"2021-01-27T16:40:25.370092+0000","last_clean":"2021-01-27T16:40:25.370092+0000","last_became_active":"2021-01-27T16:39:30.341956+0000","last_became_peered":"2021-01-27T16:39:30.341956+0000","last_unstale":"2021-01-27T16:40:25.370092+0000","last_undegraded":"2021-01-27T16:40:25.370092+0000","last_fullsized":"2021-01-27T16:40:25.370092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381956+0000","last_change":"2021-01-27T16:39:07.593638+0000","last_active":"2021-01-27T16:40:25.381956+0000","last_peered":"2021-01-27T16:40:25.381956+0000","last_clean":"2021-01-27T16:40:25.381956+0000","last_became_active":"2021-01-27T16:39:07.593064+0000","last_became_peered":"2021-01-27T16:39:07.593064+0000","last_unstale":"2021-01-27T16:40:25.381956+0000","last_undegraded":"2021-01-27T16:40:25.381956+0000","last_fullsized":"2021-01-27T16:40:25.381956+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'22","reported_seq":"58","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377221+0000","last_change":"2021-01-27T16:39:25.773801+0000","last_active":"2021-01-27T16:40:25.377221+0000","last_peered":"2021-01-27T16:40:25.377221+0000","last_clean":"2021-01-27T16:40:25.377221+0000","last_became_active":"2021-01-27T16:39:25.772701+0000","last_became_peered":"2021-01-27T16:39:25.772701+0000","last_unstale":"2021-01-27T16:40:25.377221+0000","last_undegraded":"2021-01-27T16:40:25.377221+0000","last_fullsized":"2021-01-27T16:40:25.377221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369519+0000","last_change":"2021-01-27T16:39:27.340087+0000","last_active":"2021-01-27T16:40:25.369519+0000","last_peered":"2021-01-27T16:40:25.369519+0000","last_clean":"2021-01-27T16:40:25.369519+0000","last_became_active":"2021-01-27T16:39:27.339688+0000","last_became_peered":"2021-01-27T16:39:27.339688+0000","last_unstale":"2021-01-27T16:40:25.369519+0000","last_undegraded":"2021-01-27T16:40:25.369519+0000","last_fullsized":"2021-01-27T16:40:25.369519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389119+0000","last_change":"2021-01-27T16:39:30.464726+0000","last_active":"2021-01-27T16:40:25.389119+0000","last_peered":"2021-01-27T16:40:25.389119+0000","last_clean":"2021-01-27T16:40:25.389119+0000","last_became_active":"2021-01-27T16:39:30.464282+0000","last_became_peered":"2021-01-27T16:39:30.464282+0000","last_unstale":"2021-01-27T16:40:25.389119+0000","last_undegraded":"2021-01-27T16:40:25.389119+0000","last_fullsized":"2021-01-27T16:40:25.389119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369717+0000","last_change":"2021-01-27T16:39:08.597548+0000","last_active":"2021-01-27T16:40:25.369717+0000","last_peered":"2021-01-27T16:40:25.369717+0000","last_clean":"2021-01-27T16:40:25.369717+0000","last_became_active":"2021-01-27T16:39:08.597006+0000","last_became_peered":"2021-01-27T16:39:08.597006+0000","last_unstale":"2021-01-27T16:40:25.369717+0000","last_undegraded":"2021-01-27T16:40:25.369717+0000","last_fullsized":"2021-01-27T16:40:25.369717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"59'20","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369298+0000","last_change":"2021-01-27T16:39:25.303835+0000","last_active":"2021-01-27T16:40:25.369298+0000","last_peered":"2021-01-27T16:40:25.369298+0000","last_clean":"2021-01-27T16:40:25.369298+0000","last_became_active":"2021-01-27T16:39:25.303179+0000","last_became_peered":"2021-01-27T16:39:25.303179+0000","last_unstale":"2021-01-27T16:40:25.369298+0000","last_undegraded":"2021-01-27T16:40:25.369298+0000","last_fullsized":"2021-01-27T16:40:25.369298+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340108+0000","last_change":"2021-01-27T16:39:27.337919+0000","last_active":"2021-01-27T16:42:13.340108+0000","last_peered":"2021-01-27T16:42:13.340108+0000","last_clean":"2021-01-27T16:42:13.340108+0000","last_became_active":"2021-01-27T16:39:27.337354+0000","last_became_peered":"2021-01-27T16:39:27.337354+0000","last_unstale":"2021-01-27T16:42:13.340108+0000","last_undegraded":"2021-01-27T16:42:13.340108+0000","last_fullsized":"2021-01-27T16:42:13.340108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378826+0000","last_change":"2021-01-27T16:39:30.464611+0000","last_active":"2021-01-27T16:40:25.378826+0000","last_peered":"2021-01-27T16:40:25.378826+0000","last_clean":"2021-01-27T16:40:25.378826+0000","last_became_active":"2021-01-27T16:39:30.463527+0000","last_became_peered":"2021-01-27T16:39:30.463527+0000","last_unstale":"2021-01-27T16:40:25.378826+0000","last_undegraded":"2021-01-27T16:40:25.378826+0000","last_fullsized":"2021-01-27T16:40:25.378826+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373948+0000","last_change":"2021-01-27T16:39:27.322395+0000","last_active":"2021-01-27T16:40:25.373948+0000","last_peered":"2021-01-27T16:40:25.373948+0000","last_clean":"2021-01-27T16:40:25.373948+0000","last_became_active":"2021-01-27T16:39:27.321905+0000","last_became_peered":"2021-01-27T16:39:27.321905+0000","last_unstale":"2021-01-27T16:40:25.373948+0000","last_undegraded":"2021-01-27T16:40:25.373948+0000","last_fullsized":"2021-01-27T16:40:25.373948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388351+0000","last_change":"2021-01-27T16:39:08.608737+0000","last_active":"2021-01-27T16:40:25.388351+0000","last_peered":"2021-01-27T16:40:25.388351+0000","last_clean":"2021-01-27T16:40:25.388351+0000","last_became_active":"2021-01-27T16:39:08.608246+0000","last_became_peered":"2021-01-27T16:39:08.608246+0000","last_unstale":"2021-01-27T16:40:25.388351+0000","last_undegraded":"2021-01-27T16:40:25.388351+0000","last_fullsized":"2021-01-27T16:40:25.388351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"59'15","reported_seq":"74","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.839854+0000","last_change":"2021-01-27T16:40:26.839854+0000","last_active":"2021-01-27T16:40:26.839854+0000","last_peered":"2021-01-27T16:40:26.839854+0000","last_clean":"2021-01-27T16:40:26.839854+0000","last_became_active":"2021-01-27T16:40:26.383437+0000","last_became_peered":"2021-01-27T16:40:26.383437+0000","last_unstale":"2021-01-27T16:40:26.839854+0000","last_undegraded":"2021-01-27T16:40:26.839854+0000","last_fullsized":"2021-01-27T16:40:26.839854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373123+0000","last_change":"2021-01-27T16:39:30.344007+0000","last_active":"2021-01-27T16:40:25.373123+0000","last_peered":"2021-01-27T16:40:25.373123+0000","last_clean":"2021-01-27T16:40:25.373123+0000","last_became_active":"2021-01-27T16:39:30.343634+0000","last_became_peered":"2021-01-27T16:39:30.343634+0000","last_unstale":"2021-01-27T16:40:25.373123+0000","last_undegraded":"2021-01-27T16:40:25.373123+0000","last_fullsized":"2021-01-27T16:40:25.373123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.342200+0000","last_change":"2021-01-27T16:39:27.341333+0000","last_active":"2021-01-27T16:42:13.342200+0000","last_peered":"2021-01-27T16:42:13.342200+0000","last_clean":"2021-01-27T16:42:13.342200+0000","last_became_active":"2021-01-27T16:39:27.340018+0000","last_became_peered":"2021-01-27T16:39:27.340018+0000","last_unstale":"2021-01-27T16:42:13.342200+0000","last_undegraded":"2021-01-27T16:42:13.342200+0000","last_fullsized":"2021-01-27T16:42:13.342200+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378408+0000","last_change":"2021-01-27T16:39:08.595810+0000","last_active":"2021-01-27T16:40:25.378408+0000","last_peered":"2021-01-27T16:40:25.378408+0000","last_clean":"2021-01-27T16:40:25.378408+0000","last_became_active":"2021-01-27T16:39:08.595407+0000","last_became_peered":"2021-01-27T16:39:08.595407+0000","last_unstale":"2021-01-27T16:40:25.378408+0000","last_undegraded":"2021-01-27T16:40:25.378408+0000","last_fullsized":"2021-01-27T16:40:25.378408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'17","reported_seq":"47","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379193+0000","last_change":"2021-01-27T16:39:25.317994+0000","last_active":"2021-01-27T16:40:25.379193+0000","last_peered":"2021-01-27T16:40:25.379193+0000","last_clean":"2021-01-27T16:40:25.379193+0000","last_became_active":"2021-01-27T16:39:25.317534+0000","last_became_peered":"2021-01-27T16:39:25.317534+0000","last_unstale":"2021-01-27T16:40:25.379193+0000","last_undegraded":"2021-01-27T16:40:25.379193+0000","last_fullsized":"2021-01-27T16:40:25.379193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370994+0000","last_change":"2021-01-27T16:39:30.340757+0000","last_active":"2021-01-27T16:40:25.370994+0000","last_peered":"2021-01-27T16:40:25.370994+0000","last_clean":"2021-01-27T16:40:25.370994+0000","last_became_active":"2021-01-27T16:39:30.340317+0000","last_became_peered":"2021-01-27T16:39:30.340317+0000","last_unstale":"2021-01-27T16:40:25.370994+0000","last_undegraded":"2021-01-27T16:40:25.370994+0000","last_fullsized":"2021-01-27T16:40:25.370994+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340100+0000","last_change":"2021-01-27T16:39:27.336376+0000","last_active":"2021-01-27T16:42:13.340100+0000","last_peered":"2021-01-27T16:42:13.340100+0000","last_clean":"2021-01-27T16:42:13.340100+0000","last_became_active":"2021-01-27T16:39:27.335859+0000","last_became_peered":"2021-01-27T16:39:27.335859+0000","last_unstale":"2021-01-27T16:42:13.340100+0000","last_undegraded":"2021-01-27T16:42:13.340100+0000","last_fullsized":"2021-01-27T16:42:13.340100+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378623+0000","last_change":"2021-01-27T16:39:08.601817+0000","last_active":"2021-01-27T16:40:25.378623+0000","last_peered":"2021-01-27T16:40:25.378623+0000","last_clean":"2021-01-27T16:40:25.378623+0000","last_became_active":"2021-01-27T16:39:08.601173+0000","last_became_peered":"2021-01-27T16:39:08.601173+0000","last_unstale":"2021-01-27T16:40:25.378623+0000","last_undegraded":"2021-01-27T16:40:25.378623+0000","last_fullsized":"2021-01-27T16:40:25.378623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'13","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370398+0000","last_change":"2021-01-27T16:39:25.314448+0000","last_active":"2021-01-27T16:40:25.370398+0000","last_peered":"2021-01-27T16:40:25.370398+0000","last_clean":"2021-01-27T16:40:25.370398+0000","last_became_active":"2021-01-27T16:39:25.313946+0000","last_became_peered":"2021-01-27T16:39:25.313946+0000","last_unstale":"2021-01-27T16:40:25.370398+0000","last_undegraded":"2021-01-27T16:40:25.370398+0000","last_fullsized":"2021-01-27T16:40:25.370398+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378202+0000","last_change":"2021-01-27T16:39:30.345305+0000","last_active":"2021-01-27T16:40:25.378202+0000","last_peered":"2021-01-27T16:40:25.378202+0000","last_clean":"2021-01-27T16:40:25.378202+0000","last_became_active":"2021-01-27T16:39:30.344919+0000","last_became_peered":"2021-01-27T16:39:30.344919+0000","last_unstale":"2021-01-27T16:40:25.378202+0000","last_undegraded":"2021-01-27T16:40:25.378202+0000","last_fullsized":"2021-01-27T16:40:25.378202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381865+0000","last_change":"2021-01-27T16:39:27.334639+0000","last_active":"2021-01-27T16:40:25.381865+0000","last_peered":"2021-01-27T16:40:25.381865+0000","last_clean":"2021-01-27T16:40:25.381865+0000","last_became_active":"2021-01-27T16:39:27.334228+0000","last_became_peered":"2021-01-27T16:39:27.334228+0000","last_unstale":"2021-01-27T16:40:25.381865+0000","last_undegraded":"2021-01-27T16:40:25.381865+0000","last_fullsized":"2021-01-27T16:40:25.381865+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":"59","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:07.654522+0000","last_change":"2021-01-27T16:39:08.611674+0000","last_active":"2021-01-27T16:42:07.654522+0000","last_peered":"2021-01-27T16:42:07.654522+0000","last_clean":"2021-01-27T16:42:07.654522+0000","last_became_active":"2021-01-27T16:39:08.599410+0000","last_became_peered":"2021-01-27T16:39:08.599410+0000","last_unstale":"2021-01-27T16:42:07.654522+0000","last_undegraded":"2021-01-27T16:42:07.654522+0000","last_fullsized":"2021-01-27T16:42:07.654522+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"59'21","reported_seq":"54","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371733+0000","last_change":"2021-01-27T16:39:25.311693+0000","last_active":"2021-01-27T16:40:25.371733+0000","last_peered":"2021-01-27T16:40:25.371733+0000","last_clean":"2021-01-27T16:40:25.371733+0000","last_became_active":"2021-01-27T16:39:25.311253+0000","last_became_peered":"2021-01-27T16:39:25.311253+0000","last_unstale":"2021-01-27T16:40:25.371733+0000","last_undegraded":"2021-01-27T16:40:25.371733+0000","last_fullsized":"2021-01-27T16:40:25.371733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387560+0000","last_change":"2021-01-27T16:39:30.349014+0000","last_active":"2021-01-27T16:40:25.387560+0000","last_peered":"2021-01-27T16:40:25.387560+0000","last_clean":"2021-01-27T16:40:25.387560+0000","last_became_active":"2021-01-27T16:39:30.348621+0000","last_became_peered":"2021-01-27T16:39:30.348621+0000","last_unstale":"2021-01-27T16:40:25.387560+0000","last_undegraded":"2021-01-27T16:40:25.387560+0000","last_fullsized":"2021-01-27T16:40:25.387560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377703+0000","last_change":"2021-01-27T16:39:27.329575+0000","last_active":"2021-01-27T16:40:25.377703+0000","last_peered":"2021-01-27T16:40:25.377703+0000","last_clean":"2021-01-27T16:40:25.377703+0000","last_became_active":"2021-01-27T16:39:27.328955+0000","last_became_peered":"2021-01-27T16:39:27.328955+0000","last_unstale":"2021-01-27T16:40:25.377703+0000","last_undegraded":"2021-01-27T16:40:25.377703+0000","last_fullsized":"2021-01-27T16:40:25.377703+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379638+0000","last_change":"2021-01-27T16:39:04.566323+0000","last_active":"2021-01-27T16:40:25.379638+0000","last_peered":"2021-01-27T16:40:25.379638+0000","last_clean":"2021-01-27T16:40:25.379638+0000","last_became_active":"2021-01-27T16:39:04.565281+0000","last_became_peered":"2021-01-27T16:39:04.565281+0000","last_unstale":"2021-01-27T16:40:25.379638+0000","last_undegraded":"2021-01-27T16:40:25.379638+0000","last_fullsized":"2021-01-27T16:40:25.379638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'23","reported_seq":"57","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368227+0000","last_change":"2021-01-27T16:39:25.774483+0000","last_active":"2021-01-27T16:40:25.368227+0000","last_peered":"2021-01-27T16:40:25.368227+0000","last_clean":"2021-01-27T16:40:25.368227+0000","last_became_active":"2021-01-27T16:39:25.773490+0000","last_became_peered":"2021-01-27T16:39:25.773490+0000","last_unstale":"2021-01-27T16:40:25.368227+0000","last_undegraded":"2021-01-27T16:40:25.368227+0000","last_fullsized":"2021-01-27T16:40:25.368227+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385945+0000","last_change":"2021-01-27T16:39:30.340744+0000","last_active":"2021-01-27T16:40:25.385945+0000","last_peered":"2021-01-27T16:40:25.385945+0000","last_clean":"2021-01-27T16:40:25.385945+0000","last_became_active":"2021-01-27T16:39:30.340312+0000","last_became_peered":"2021-01-27T16:39:30.340312+0000","last_unstale":"2021-01-27T16:40:25.385945+0000","last_undegraded":"2021-01-27T16:40:25.385945+0000","last_fullsized":"2021-01-27T16:40:25.385945+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377450+0000","last_change":"2021-01-27T16:39:27.324829+0000","last_active":"2021-01-27T16:40:25.377450+0000","last_peered":"2021-01-27T16:40:25.377450+0000","last_clean":"2021-01-27T16:40:25.377450+0000","last_became_active":"2021-01-27T16:39:27.324323+0000","last_became_peered":"2021-01-27T16:39:27.324323+0000","last_unstale":"2021-01-27T16:40:25.377450+0000","last_undegraded":"2021-01-27T16:40:25.377450+0000","last_fullsized":"2021-01-27T16:40:25.377450+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379086+0000","last_change":"2021-01-27T16:39:04.559602+0000","last_active":"2021-01-27T16:40:25.379086+0000","last_peered":"2021-01-27T16:40:25.379086+0000","last_clean":"2021-01-27T16:40:25.379086+0000","last_became_active":"2021-01-27T16:39:04.559170+0000","last_became_peered":"2021-01-27T16:39:04.559170+0000","last_unstale":"2021-01-27T16:40:25.379086+0000","last_undegraded":"2021-01-27T16:40:25.379086+0000","last_fullsized":"2021-01-27T16:40:25.379086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"59'14","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386705+0000","last_change":"2021-01-27T16:39:25.312485+0000","last_active":"2021-01-27T16:40:25.386705+0000","last_peered":"2021-01-27T16:40:25.386705+0000","last_clean":"2021-01-27T16:40:25.386705+0000","last_became_active":"2021-01-27T16:39:25.312117+0000","last_became_peered":"2021-01-27T16:39:25.312117+0000","last_unstale":"2021-01-27T16:40:25.386705+0000","last_undegraded":"2021-01-27T16:40:25.386705+0000","last_fullsized":"2021-01-27T16:40:25.386705+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370443+0000","last_change":"2021-01-27T16:39:30.465944+0000","last_active":"2021-01-27T16:40:25.370443+0000","last_peered":"2021-01-27T16:40:25.370443+0000","last_clean":"2021-01-27T16:40:25.370443+0000","last_became_active":"2021-01-27T16:39:30.465516+0000","last_became_peered":"2021-01-27T16:39:30.465516+0000","last_unstale":"2021-01-27T16:40:25.370443+0000","last_undegraded":"2021-01-27T16:40:25.370443+0000","last_fullsized":"2021-01-27T16:40:25.370443+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378370+0000","last_change":"2021-01-27T16:39:08.595828+0000","last_active":"2021-01-27T16:40:25.378370+0000","last_peered":"2021-01-27T16:40:25.378370+0000","last_clean":"2021-01-27T16:40:25.378370+0000","last_became_active":"2021-01-27T16:39:08.594390+0000","last_became_peered":"2021-01-27T16:39:08.594390+0000","last_unstale":"2021-01-27T16:40:25.378370+0000","last_undegraded":"2021-01-27T16:40:25.378370+0000","last_fullsized":"2021-01-27T16:40:25.378370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'18","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370222+0000","last_change":"2021-01-27T16:39:25.773041+0000","last_active":"2021-01-27T16:40:25.370222+0000","last_peered":"2021-01-27T16:40:25.370222+0000","last_clean":"2021-01-27T16:40:25.370222+0000","last_became_active":"2021-01-27T16:39:25.771788+0000","last_became_peered":"2021-01-27T16:39:25.771788+0000","last_unstale":"2021-01-27T16:40:25.370222+0000","last_undegraded":"2021-01-27T16:40:25.370222+0000","last_fullsized":"2021-01-27T16:40:25.370222+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'2","reported_seq":"52","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:08.338701+0000","last_change":"2021-01-27T16:39:27.344696+0000","last_active":"2021-01-27T16:42:08.338701+0000","last_peered":"2021-01-27T16:42:08.338701+0000","last_clean":"2021-01-27T16:42:08.338701+0000","last_became_active":"2021-01-27T16:39:27.344394+0000","last_became_peered":"2021-01-27T16:39:27.344394+0000","last_unstale":"2021-01-27T16:42:08.338701+0000","last_undegraded":"2021-01-27T16:42:08.338701+0000","last_fullsized":"2021-01-27T16:42:08.338701+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":2536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":159,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430248,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6144,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739008,"statfs":{"total":95995035648,"available":95988744192,"internally_reserved":0,"allocated":843776,"data_stored":287712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.206,"15min":2.246},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.8839999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":2.6949999999999998},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.032,"15min":1.9670000000000001},"min":{"1min":1.3129999999999999,"5min":1.234,"15min":1.234},"max":{"1min":3.6429999999999998,"5min":4.117,"15min":4.117},"last":2.2709999999999999}]},{"osd":1,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.351,"15min":2.3719999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":3.5289999999999999,"5min":5.2949999999999999,"15min":5.2949999999999999},"last":2.1800000000000002},{"interface":"front","average":{"1min":2.4460000000000002,"5min":2.552,"15min":2.5739999999999998},"min":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":1.6539999999999999}]},{"osd":2,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":2.2570000000000001,"15min":2.2970000000000002},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.177,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":2.0209999999999999},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.9609999999999999,"15min":3.085},"min":{"1min":1.397,"5min":1.397,"15min":1.397},"max":{"1min":3.7650000000000001,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":3.5030000000000001}]},{"osd":3,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":2.5760000000000001,"15min":2.6120000000000001},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.375,"5min":4.6189999999999998,"15min":4.6189999999999998},"last":2.9950000000000001},{"interface":"front","average":{"1min":3.04,"5min":3.2360000000000002,"15min":3.3439999999999999},"min":{"1min":1.264,"5min":1.264,"15min":1.264},"max":{"1min":3.8769999999999998,"5min":8.7799999999999994,"15min":8.7799999999999994},"last":3.141}]},{"osd":4,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.1539999999999999,"5min":2.9430000000000001,"15min":2.867},"min":{"1min":1.353,"5min":1.3520000000000001,"15min":1.3520000000000001},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":2.6299999999999999},{"interface":"front","average":{"1min":2.899,"5min":2.9409999999999998,"15min":2.9780000000000002},"min":{"1min":1.474,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":3.7650000000000001,"5min":7.2169999999999996,"15min":7.2169999999999996},"last":2.5390000000000001}]},{"osd":5,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.3809999999999998,"5min":3.2679999999999998,"15min":3.226},"min":{"1min":1.52,"5min":1.52,"15min":1.52},"max":{"1min":4.3559999999999999,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.802},{"interface":"front","average":{"1min":3.3639999999999999,"5min":3.2770000000000001,"15min":3.2269999999999999},"min":{"1min":1.6839999999999999,"5min":1.593,"15min":1.593},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":4.4459999999999997},"last":3.573}]},{"osd":6,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.5960000000000001,"5min":3.556,"15min":3.5449999999999999},"min":{"1min":1.7869999999999999,"5min":1.343,"15min":1.343},"max":{"1min":4.6870000000000003,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":3.1019999999999999},{"interface":"front","average":{"1min":3.379,"5min":3.54,"15min":3.6120000000000001},"min":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"max":{"1min":4.3280000000000003,"5min":8.282,"15min":8.282},"last":3.4199999999999999}]}]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6320,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738832,"statfs":{"total":95995035648,"available":95988563968,"internally_reserved":0,"allocated":892928,"data_stored":289027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.9219999999999999,"15min":1.8979999999999999},"min":{"1min":1.103,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.98,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.7370000000000001},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.0899999999999999,"15min":2.032},"min":{"1min":1.4730000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"max":{"1min":3.1899999999999999,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":1.8360000000000001}]},{"osd":1,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1280000000000001},"min":{"1min":1.514,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":4.5960000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":2.7509999999999999},{"interface":"front","average":{"1min":2.5339999999999998,"5min":2.427,"15min":2.4180000000000001},"min":{"1min":1.5860000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"max":{"1min":3.6230000000000002,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":2.1819999999999999}]},{"osd":2,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":2.399,"15min":2.383},"min":{"1min":1.641,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":3.871,"5min":3.911,"15min":3.911},"last":2.6760000000000002},{"interface":"front","average":{"1min":2.794,"5min":2.6349999999999998,"15min":2.6280000000000001},"min":{"1min":1.8029999999999999,"5min":1.413,"15min":1.413},"max":{"1min":5.1260000000000003,"5min":5.1260000000000003,"15min":5.1260000000000003},"last":2.8420000000000001}]},{"osd":3,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.7450000000000001,"5min":2.5379999999999998,"15min":2.4620000000000002},"min":{"1min":1.6359999999999999,"5min":1.357,"15min":1.357},"max":{"1min":3.8130000000000002,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":3.0510000000000002},{"interface":"front","average":{"1min":2.9980000000000002,"5min":2.7709999999999999,"15min":2.7389999999999999},"min":{"1min":2.0249999999999999,"5min":1.492,"15min":1.492},"max":{"1min":4.6479999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":3.016}]},{"osd":4,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":2.7290000000000001,"15min":2.6150000000000002},"min":{"1min":2.081,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4969999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":3.327},{"interface":"front","average":{"1min":3.1000000000000001,"5min":2.859,"15min":2.7679999999999998},"min":{"1min":2.1019999999999999,"5min":1.663,"15min":1.663},"max":{"1min":4.1200000000000001,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":3.2549999999999999}]},{"osd":5,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":2.9660000000000002,"15min":2.8679999999999999},"min":{"1min":2.4350000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"max":{"1min":4.2990000000000004,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":3.5899999999999999},{"interface":"front","average":{"1min":3.3719999999999999,"5min":3.137,"15min":3.0539999999999998},"min":{"1min":2.133,"5min":1.952,"15min":1.952},"max":{"1min":4.9409999999999998,"5min":5.3109999999999999,"15min":5.3109999999999999},"last":3.472}]},{"osd":7,"last update":"Wed Jan 27 16:42:10 2021","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.5649999999999999,"15min":3.5600000000000001},"min":{"1min":2.5539999999999998,"5min":2.1230000000000002,"15min":2.1230000000000002},"max":{"1min":4.7089999999999996,"5min":4.7279999999999998,"15min":4.7279999999999998},"last":3.802},{"interface":"front","average":{"1min":3.8180000000000001,"5min":3.6120000000000001,"15min":3.5950000000000002},"min":{"1min":2.8980000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"max":{"1min":5.109,"5min":5.46,"15min":5.46},"last":3.665}]}]},{"osd":1,"up_from":16,"seq":68719476813,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6712,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738440,"statfs":{"total":95995035648,"available":95988162560,"internally_reserved":0,"allocated":966656,"data_stored":291320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:22 2021","interfaces":[{"interface":"back","average":{"1min":2.008,"5min":1.764,"15min":1.49},"min":{"1min":1.3560000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":2.2570000000000001},{"interface":"front","average":{"1min":2.0760000000000001,"5min":1.8600000000000001,"15min":1.5880000000000001},"min":{"1min":1.306,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":3.0169999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":2.375}]},{"osd":2,"last update":"Wed Jan 27 16:41:46 2021","interfaces":[{"interface":"back","average":{"1min":2.2189999999999999,"5min":2.1000000000000001,"15min":1.825},"min":{"1min":1.411,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.8260000000000001,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":3.2480000000000002},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.2639999999999998,"15min":2.0649999999999999},"min":{"1min":1.302,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.2829999999999999,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":3.5600000000000001}]},{"osd":3,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.4790000000000001,"15min":2.3849999999999998},"min":{"1min":1.8080000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.1000000000000001,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":3.1339999999999999},{"interface":"front","average":{"1min":2.294,"5min":2.2789999999999999,"15min":2.1749999999999998},"min":{"1min":1.456,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.9820000000000002,"5min":4.359,"15min":4.359},"last":3.0619999999999998}]},{"osd":4,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":2.4870000000000001,"15min":2.4900000000000002},"min":{"1min":1.607,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":3.0880000000000001,"5min":3.637,"15min":3.637},"last":2.5619999999999998},{"interface":"front","average":{"1min":2.9359999999999999,"5min":2.8919999999999999,"15min":2.778},"min":{"1min":1.7350000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":3.5870000000000002,"5min":4.7210000000000001,"15min":4.7210000000000001},"last":3.6800000000000002}]},{"osd":5,"last update":"Wed Jan 27 16:42:07 2021","interfaces":[{"interface":"back","average":{"1min":3.1880000000000002,"5min":3.1779999999999999,"15min":3.0339999999999998},"min":{"1min":2.1669999999999998,"5min":1.599,"15min":1.599},"max":{"1min":3.9340000000000002,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":4.4550000000000001},{"interface":"front","average":{"1min":3.266,"5min":3.1779999999999999,"15min":3.0819999999999999},"min":{"1min":2.5379999999999998,"5min":1.6279999999999999,"15min":1.6279999999999999},"max":{"1min":4.1079999999999997,"5min":4.6900000000000004,"15min":4.6900000000000004},"last":4.0960000000000001}]},{"osd":6,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":2.9830000000000001,"15min":2.9809999999999999},"min":{"1min":1.8180000000000001,"5min":1.47,"15min":1.47},"max":{"1min":3.6709999999999998,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":3.4809999999999999},{"interface":"front","average":{"1min":3.4929999999999999,"5min":3.4409999999999998,"15min":3.379},"min":{"1min":2.3679999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"max":{"1min":4.1589999999999998,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":4.0380000000000003}]},{"osd":7,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":3.2959999999999998,"5min":3.29,"15min":3.3039999999999998},"min":{"1min":2.351,"5min":2.351,"15min":2.351},"max":{"1min":3.9929999999999999,"5min":5.3810000000000002,"15min":5.3810000000000002},"last":3.8500000000000001},{"interface":"front","average":{"1min":3.7320000000000002,"5min":3.7090000000000001,"15min":3.6739999999999999},"min":{"1min":2.7450000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"max":{"1min":4.3810000000000002,"5min":6.9690000000000003,"15min":6.9690000000000003},"last":4.2530000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673042,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6472,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738680,"statfs":{"total":95995035648,"available":95988408320,"internally_reserved":0,"allocated":851968,"data_stored":287544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 16:41:25 2021","interfaces":[{"interface":"back","average":{"1min":1.9550000000000001,"5min":1.8260000000000001,"15min":1.5089999999999999},"min":{"1min":1.2170000000000001,"5min":0.87,"15min":0.87},"max":{"1min":3.258,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":2.4700000000000002},{"interface":"front","average":{"1min":2.4489999999999998,"5min":2.1320000000000001,"15min":1.7210000000000001},"min":{"1min":1.2450000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.1689999999999996,"5min":8.1270000000000007,"15min":8.1270000000000007},"last":2.5600000000000001}]},{"osd":2,"last update":"Wed Jan 27 16:41:49 2021","interfaces":[{"interface":"back","average":{"1min":2.536,"5min":2.2989999999999999,"15min":2.073},"min":{"1min":1.839,"5min":1.321,"15min":1.321},"max":{"1min":3.3860000000000001,"5min":7.0010000000000003,"15min":7.0010000000000003},"last":3.1179999999999999},{"interface":"front","average":{"1min":2.2690000000000001,"5min":2.1840000000000002,"15min":1.954},"min":{"1min":1.6319999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"max":{"1min":4.0720000000000001,"5min":8.5860000000000003,"15min":8.5860000000000003},"last":2.661}]},{"osd":3,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":2.7570000000000001,"5min":2.577,"15min":2.4020000000000001},"min":{"1min":1.8779999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":3.335,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":3.3690000000000002},{"interface":"front","average":{"1min":2.681,"5min":2.6200000000000001,"15min":2.4710000000000001},"min":{"1min":1.6180000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"max":{"1min":3.6680000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":3.177}]},{"osd":4,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":2.7360000000000002,"15min":2.657},"min":{"1min":2.419,"5min":1.7549999999999999,"15min":1.7549999999999999},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":3.4209999999999998},{"interface":"front","average":{"1min":3.0169999999999999,"5min":2.895,"15min":2.7000000000000002},"min":{"1min":2.4729999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.887,"5min":10.484999999999999,"15min":10.484999999999999},"last":3.7949999999999999}]},{"osd":5,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.1509999999999998,"5min":3.1440000000000001,"15min":3.1019999999999999},"min":{"1min":1.9770000000000001,"5min":1.881,"15min":1.881},"max":{"1min":4.0279999999999996,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":3.645},{"interface":"front","average":{"1min":3.391,"5min":3.3079999999999998,"15min":3.105},"min":{"1min":2.1949999999999998,"5min":1.6659999999999999,"15min":1.6659999999999999},"max":{"1min":3.9039999999999999,"5min":12.02,"15min":12.02},"last":4.0650000000000004}]},{"osd":6,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":3.681,"5min":3.4769999999999999,"15min":3.5009999999999999},"min":{"1min":2.8799999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"max":{"1min":5.399,"5min":6.5529999999999999,"15min":6.5529999999999999},"last":3.9910000000000001},{"interface":"front","average":{"1min":3.798,"5min":3.6989999999999998,"15min":3.762},"min":{"1min":2.851,"5min":2.0110000000000001,"15min":2.0110000000000001},"max":{"1min":5.0590000000000002,"5min":7.8280000000000003,"15min":7.8280000000000003},"last":3.9529999999999998}]},{"osd":7,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.6970000000000001,"5min":3.9060000000000001,"15min":4.04},"min":{"1min":2.4529999999999998,"5min":2.113,"15min":2.113},"max":{"1min":4.3300000000000001,"5min":12.147,"15min":12.147},"last":4.3220000000000001},{"interface":"front","average":{"1min":3.8399999999999999,"5min":3.827,"15min":3.8109999999999999},"min":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"max":{"1min":4.5490000000000004,"5min":8.3239999999999998,"15min":8.3239999999999998},"last":4.8959999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313287,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":811008,"data_stored":286033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.944,"15min":1.7270000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":2.5099999999999998},{"interface":"front","average":{"1min":2.0289999999999999,"5min":2.0129999999999999,"15min":1.758},"min":{"1min":1.2549999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.7530000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":2.1360000000000001}]},{"osd":1,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.1539999999999999,"15min":1.8320000000000001},"min":{"1min":1.0760000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":5.1050000000000004,"5min":5.1050000000000004,"15min":5.1050000000000004},"last":2.0699999999999998},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.262,"15min":2.02},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":3.097}]},{"osd":3,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":2.629,"5min":2.6829999999999998,"15min":2.407},"min":{"1min":1.956,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":3.2400000000000002,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":2.3100000000000001},{"interface":"front","average":{"1min":2.7759999999999998,"5min":2.7309999999999999,"15min":2.544},"min":{"1min":1.581,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":3.488,"5min":4.7679999999999998,"15min":4.7679999999999998},"last":3.484}]},{"osd":4,"last update":"Wed Jan 27 16:41:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":2.3279999999999998,"15min":2.2429999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":3.266,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":2.2240000000000002},{"interface":"front","average":{"1min":3.0369999999999999,"5min":3.0139999999999998,"15min":2.8460000000000001},"min":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":3.6560000000000001}]},{"osd":5,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":3.109,"15min":3.077},"min":{"1min":2.0920000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"max":{"1min":3.956,"5min":5.1559999999999997,"15min":5.1559999999999997},"last":3.9049999999999998},{"interface":"front","average":{"1min":2.726,"5min":2.7450000000000001,"15min":2.6989999999999998},"min":{"1min":1.823,"5min":1.2470000000000001,"15min":1.2470000000000001},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":2.907}]},{"osd":6,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":3.032,"15min":3.0089999999999999},"min":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"max":{"1min":4.1200000000000001,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":2.6949999999999998},{"interface":"front","average":{"1min":3.3149999999999999,"5min":3.5840000000000001,"15min":3.665},"min":{"1min":1.756,"5min":1.756,"15min":1.756},"max":{"1min":5.3810000000000002,"5min":5.3810000000000002,"15min":5.3810000000000002},"last":4.3019999999999996}]},{"osd":7,"last update":"Wed Jan 27 16:42:12 2021","interfaces":[{"interface":"back","average":{"1min":3.3919999999999999,"5min":3.5529999999999999,"15min":3.6110000000000002},"min":{"1min":2.4940000000000002,"5min":1.607,"15min":1.607},"max":{"1min":3.9660000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":3.9969999999999999},{"interface":"front","average":{"1min":3.4889999999999999,"5min":3.7010000000000001,"15min":3.77},"min":{"1min":2.532,"5min":2.1019999999999999,"15min":2.1019999999999999},"max":{"1min":4.4039999999999999,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":4.7279999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6504,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738648,"statfs":{"total":95995035648,"available":95988375552,"internally_reserved":0,"allocated":950272,"data_stored":290818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":1.9279999999999999,"15min":1.6519999999999999},"min":{"1min":1.498,"5min":1.012,"15min":1.012},"max":{"1min":2.8410000000000002,"5min":8.875,"15min":8.875},"last":1.194},{"interface":"front","average":{"1min":2.4409999999999998,"5min":2.3559999999999999,"15min":2.1150000000000002},"min":{"1min":1.7889999999999999,"5min":1.401,"15min":1.401},"max":{"1min":3.4260000000000002,"5min":8.9890000000000008,"15min":8.9890000000000008},"last":1.589}]},{"osd":1,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":2.036,"15min":1.923},"min":{"1min":1.716,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":1.405},{"interface":"front","average":{"1min":2.206,"5min":2.1640000000000001,"15min":2.1040000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":4.117,"5min":4.117,"15min":4.117},"last":2.1669999999999998}]},{"osd":2,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.3490000000000002,"15min":2.1930000000000001},"min":{"1min":1.796,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.4340000000000002,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":2.5099999999999998},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.5760000000000001,"15min":2.5089999999999999},"min":{"1min":1.827,"5min":1.452,"15min":1.452},"max":{"1min":4.9109999999999996,"5min":5.1459999999999999,"15min":5.1459999999999999},"last":1.665}]},{"osd":4,"last update":"Wed Jan 27 16:41:44 2021","interfaces":[{"interface":"back","average":{"1min":2.9510000000000001,"5min":2.6989999999999998,"15min":2.4990000000000001},"min":{"1min":1.528,"5min":1.528,"15min":1.528},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":2.3999999999999999},{"interface":"front","average":{"1min":2.9329999999999998,"5min":2.7389999999999999,"15min":2.6429999999999998},"min":{"1min":1.625,"5min":1.625,"15min":1.625},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":2.4689999999999999}]},{"osd":5,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":3.1179999999999999,"5min":3.016,"15min":2.964},"min":{"1min":2.2250000000000001,"5min":1.617,"15min":1.617},"max":{"1min":4.2309999999999999,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":2.887},{"interface":"front","average":{"1min":3.419,"5min":3.1989999999999998,"15min":3.077},"min":{"1min":2.649,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":4.1150000000000002,"5min":4.4690000000000003,"15min":4.4690000000000003},"last":2.7440000000000002}]},{"osd":6,"last update":"Wed Jan 27 16:41:44 2021","interfaces":[{"interface":"back","average":{"1min":3.1970000000000001,"5min":3.2509999999999999,"15min":3.27},"min":{"1min":1.776,"5min":1.776,"15min":1.776},"max":{"1min":3.9039999999999999,"5min":4.1449999999999996,"15min":4.1449999999999996},"last":2.6520000000000001},{"interface":"front","average":{"1min":3.4289999999999998,"5min":3.359,"15min":3.363},"min":{"1min":2.4100000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":3.2829999999999999}]},{"osd":7,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":3.5699999999999998,"15min":3.5579999999999998},"min":{"1min":2.1709999999999998,"5min":2.097,"15min":2.097},"max":{"1min":4.5049999999999999,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":3.133},{"interface":"front","average":{"1min":3.7050000000000001,"5min":3.6000000000000001,"15min":3.5800000000000001},"min":{"1min":2.5299999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":2.8079999999999998}]}]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6460,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738692,"statfs":{"total":95995035648,"available":95988420608,"internally_reserved":0,"allocated":905216,"data_stored":289731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.0430000000000001,"15min":2.0329999999999999},"min":{"1min":1.6080000000000001,"5min":1.044,"15min":1.044},"max":{"1min":2.9399999999999999,"5min":5.9130000000000003,"15min":5.9130000000000003},"last":1.2430000000000001},{"interface":"front","average":{"1min":2.2480000000000002,"5min":2.048,"15min":2.0179999999999998},"min":{"1min":1.4159999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.6019999999999999,"5min":6.8300000000000001,"15min":6.8300000000000001},"last":1.3799999999999999}]},{"osd":1,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.198,"15min":2.1040000000000001},"min":{"1min":1.369,"5min":1.302,"15min":1.302},"max":{"1min":3.109,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":1.698},{"interface":"front","average":{"1min":2.5310000000000001,"5min":2.3610000000000002,"15min":2.3420000000000001},"min":{"1min":1.8440000000000001,"5min":1.202,"15min":1.202},"max":{"1min":3.7770000000000001,"5min":7.0449999999999999,"15min":7.0449999999999999},"last":1.978}]},{"osd":2,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":2.5110000000000001,"15min":2.456},"min":{"1min":2.052,"5min":1.3979999999999999,"15min":1.3979999999999999},"max":{"1min":3.4079999999999999,"5min":7.2030000000000003,"15min":7.2030000000000003},"last":2.3919999999999999},{"interface":"front","average":{"1min":2.4169999999999998,"5min":2.2850000000000001,"15min":2.2200000000000002},"min":{"1min":1.885,"5min":1.466,"15min":1.466},"max":{"1min":3.3889999999999998,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":1.8200000000000001}]},{"osd":3,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5790000000000002,"5min":2.3700000000000001,"15min":2.306},"min":{"1min":1.748,"5min":1.397,"15min":1.397},"max":{"1min":3.383,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":2.6520000000000001},{"interface":"front","average":{"1min":3.1030000000000002,"5min":2.8149999999999999,"15min":2.6840000000000002},"min":{"1min":2.4550000000000001,"5min":1.385,"15min":1.385},"max":{"1min":3.6299999999999999,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":2.081}]},{"osd":5,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.157,"5min":2.9180000000000001,"15min":2.7080000000000002},"min":{"1min":2.4359999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":4.0129999999999999,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":2.8119999999999998},{"interface":"front","average":{"1min":2.9889999999999999,"5min":2.706,"15min":2.5880000000000001},"min":{"1min":1.9490000000000001,"5min":1.173,"15min":1.173},"max":{"1min":3.6949999999999998,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":2.258}]},{"osd":6,"last update":"Wed Jan 27 16:41:49 2021","interfaces":[{"interface":"back","average":{"1min":3.4630000000000001,"5min":2.996,"15min":2.8380000000000001},"min":{"1min":2.496,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":4.5709999999999997,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":2.3359999999999999},{"interface":"front","average":{"1min":3.5840000000000001,"5min":3.0779999999999998,"15min":2.9359999999999999},"min":{"1min":2.9169999999999998,"5min":1.444,"15min":1.444},"max":{"1min":4.2229999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":3.2240000000000002}]},{"osd":7,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.371,"5min":3.177,"15min":3.1099999999999999},"min":{"1min":2.7679999999999998,"5min":1.405,"15min":1.405},"max":{"1min":3.9750000000000001,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":2.927},{"interface":"front","average":{"1min":3.5649999999999999,"5min":3.4350000000000001,"15min":3.383},"min":{"1min":3.0449999999999999,"5min":1.548,"15min":1.548},"max":{"1min":4.3680000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":3.5990000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6248,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738904,"statfs":{"total":95995035648,"available":95988637696,"internally_reserved":0,"allocated":819200,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.9159999999999999,"15min":1.77},"min":{"1min":1.502,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":2.306,"5min":2.0800000000000001,"15min":1.996},"min":{"1min":1.552,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.8969999999999998,"5min":3.8969999999999998,"15min":3.8969999999999998},"last":2.6259999999999999}]},{"osd":1,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.173,"15min":2.2189999999999999},"min":{"1min":1.3169999999999999,"5min":0.872,"15min":0.872},"max":{"1min":2.9620000000000002,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":2.1309999999999998},{"interface":"front","average":{"1min":2.7869999999999999,"5min":2.4670000000000001,"15min":2.3540000000000001},"min":{"1min":1.8280000000000001,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.835,"5min":4.5179999999999998,"15min":4.5179999999999998},"last":2.306}]},{"osd":2,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":2.4169999999999998,"15min":2.2650000000000001},"min":{"1min":1.629,"5min":1.099,"15min":1.099},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":1.95},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.589,"15min":2.5800000000000001},"min":{"1min":1.6160000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":3.762,"5min":5.2469999999999999,"15min":5.2469999999999999},"last":2.508}]},{"osd":3,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.7200000000000002,"15min":2.5329999999999999},"min":{"1min":2.395,"5min":1.3129999999999999,"15min":1.3129999999999999},"max":{"1min":4.6050000000000004,"5min":4.9509999999999996,"15min":4.9509999999999996},"last":2.7090000000000001},{"interface":"front","average":{"1min":2.887,"5min":2.7829999999999999,"15min":2.7229999999999999},"min":{"1min":1.8129999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2569999999999997,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":3.2789999999999999}]},{"osd":4,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":2.8730000000000002,"15min":2.661},"min":{"1min":1.8240000000000001,"5min":1.161,"15min":1.161},"max":{"1min":4.4530000000000003,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":3.113},{"interface":"front","average":{"1min":3.3660000000000001,"5min":2.8929999999999998,"15min":2.7120000000000002},"min":{"1min":2.4769999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":4.4749999999999996,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":2.9969999999999999}]},{"osd":6,"last update":"Wed Jan 27 16:41:45 2021","interfaces":[{"interface":"back","average":{"1min":3.4159999999999999,"5min":3.1150000000000002,"15min":2.9849999999999999},"min":{"1min":2.6829999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":4.7089999999999996,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":2.9119999999999999},{"interface":"front","average":{"1min":3.8410000000000002,"5min":3.3119999999999998,"15min":3.161},"min":{"1min":2.6549999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"max":{"1min":5.8170000000000002,"5min":6.633,"15min":6.633},"last":3.3700000000000001}]},{"osd":7,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.7759999999999998,"5min":3.5019999999999998,"15min":3.3820000000000001},"min":{"1min":3.0209999999999999,"5min":1.506,"15min":1.506},"max":{"1min":4.9050000000000002,"5min":5.7839999999999998,"15min":5.7839999999999998},"last":3.448},{"interface":"front","average":{"1min":3.9359999999999999,"5min":3.6890000000000001,"15min":3.6160000000000001},"min":{"1min":2.9289999999999998,"5min":1.55,"15min":1.55},"max":{"1min":5.2000000000000002,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":3.617}]}]}]}} 2021-01-27T16:42:22.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph pg dump --format=json 2021-01-27T16:42:22.939 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:23.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:23 smithi106 bash[9795]: audit 2021-01-27T16:42:21.675235+0000 mgr.y (mgr.14138) 449 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:23.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:23 smithi106 bash[9795]: audit 2021-01-27T16:42:21.923121+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:23.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:23 smithi106 bash[13484]: audit 2021-01-27T16:42:21.675235+0000 mgr.y (mgr.14138) 449 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:23.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:23 smithi106 bash[13484]: audit 2021-01-27T16:42:21.923121+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:23 smithi094 bash[9811]: audit 2021-01-27T16:42:21.675235+0000 mgr.y (mgr.14138) 449 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:23.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:23 smithi094 bash[9811]: audit 2021-01-27T16:42:21.923121+0000 mgr.y (mgr.14138) 450 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:24.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:24 smithi094 bash[9811]: cluster 2021-01-27T16:42:23.467861+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:24.304 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:24 smithi106 bash[9795]: cluster 2021-01-27T16:42:23.467861+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:24.304 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:24 smithi106 bash[13484]: cluster 2021-01-27T16:42:23.467861+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:25.866 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:25 smithi106 bash[9795]: cluster 2021-01-27T16:42:25.468951+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:25.866 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:25 smithi106 bash[13484]: cluster 2021-01-27T16:42:25.468951+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:26.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:25 smithi094 bash[9811]: cluster 2021-01-27T16:42:25.468951+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:26.299 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:42:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2021-01-27T16:42:26.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[9795]: audit 2021-01-27T16:42:25.748276+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:42:26.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[9795]: audit 2021-01-27T16:42:25.751534+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:42:26.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[9795]: audit 2021-01-27T16:42:26.272425+0000 mgr.y (mgr.14138) 453 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:26.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[13484]: audit 2021-01-27T16:42:25.748276+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:42:26.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[13484]: audit 2021-01-27T16:42:25.751534+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:42:26.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:26 smithi106 bash[13484]: audit 2021-01-27T16:42:26.272425+0000 mgr.y (mgr.14138) 453 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:26 smithi094 bash[9811]: audit 2021-01-27T16:42:25.748276+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:42:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:26 smithi094 bash[9811]: audit 2021-01-27T16:42:25.751534+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:42:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:26 smithi094 bash[9811]: audit 2021-01-27T16:42:26.272425+0000 mgr.y (mgr.14138) 453 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-27T16:42:27.088 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2021-01-27T16:42:25.468215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":1264,"num_read_kb":764,"num_write":567,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":2849,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51164,"kb_used_data":6876,"kb_used_omap":0,"kb_used_meta":44224,"kb_avail":749910052,"statfs":{"total":767960285184,"available":767907893248,"internally_reserved":0,"allocated":7041024,"data_stored":2308078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45285376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006885"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378220+0000","last_change":"2021-01-27T16:39:30.470066+0000","last_active":"2021-01-27T16:40:25.378220+0000","last_peered":"2021-01-27T16:40:25.378220+0000","last_clean":"2021-01-27T16:40:25.378220+0000","last_became_active":"2021-01-27T16:39:30.468804+0000","last_became_peered":"2021-01-27T16:39:30.468804+0000","last_unstale":"2021-01-27T16:40:25.378220+0000","last_undegraded":"2021-01-27T16:40:25.378220+0000","last_fullsized":"2021-01-27T16:40:25.378220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368739+0000","last_change":"2021-01-27T16:39:27.338452+0000","last_active":"2021-01-27T16:40:25.368739+0000","last_peered":"2021-01-27T16:40:25.368739+0000","last_clean":"2021-01-27T16:40:25.368739+0000","last_became_active":"2021-01-27T16:39:27.338029+0000","last_became_peered":"2021-01-27T16:39:27.338029+0000","last_unstale":"2021-01-27T16:40:25.368739+0000","last_undegraded":"2021-01-27T16:40:25.368739+0000","last_fullsized":"2021-01-27T16:40:25.368739+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"45'1","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387242+0000","last_change":"2021-01-27T16:39:08.702567+0000","last_active":"2021-01-27T16:40:25.387242+0000","last_peered":"2021-01-27T16:40:25.387242+0000","last_clean":"2021-01-27T16:40:25.387242+0000","last_became_active":"2021-01-27T16:39:08.601354+0000","last_became_peered":"2021-01-27T16:39:08.601354+0000","last_unstale":"2021-01-27T16:40:25.387242+0000","last_undegraded":"2021-01-27T16:40:25.387242+0000","last_fullsized":"2021-01-27T16:40:25.387242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"59'20","reported_seq":"53","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378089+0000","last_change":"2021-01-27T16:39:25.312530+0000","last_active":"2021-01-27T16:40:25.378089+0000","last_peered":"2021-01-27T16:40:25.378089+0000","last_clean":"2021-01-27T16:40:25.378089+0000","last_became_active":"2021-01-27T16:39:25.311697+0000","last_became_peered":"2021-01-27T16:39:25.311697+0000","last_unstale":"2021-01-27T16:40:25.378089+0000","last_undegraded":"2021-01-27T16:40:25.378089+0000","last_fullsized":"2021-01-27T16:40:25.378089+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":22,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369501+0000","last_change":"2021-01-27T16:39:30.352287+0000","last_active":"2021-01-27T16:40:25.369501+0000","last_peered":"2021-01-27T16:40:25.369501+0000","last_clean":"2021-01-27T16:40:25.369501+0000","last_became_active":"2021-01-27T16:39:30.351891+0000","last_became_peered":"2021-01-27T16:39:30.351891+0000","last_unstale":"2021-01-27T16:40:25.369501+0000","last_undegraded":"2021-01-27T16:40:25.369501+0000","last_fullsized":"2021-01-27T16:40:25.369501+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378267+0000","last_change":"2021-01-27T16:39:27.334576+0000","last_active":"2021-01-27T16:40:25.378267+0000","last_peered":"2021-01-27T16:40:25.378267+0000","last_clean":"2021-01-27T16:40:25.378267+0000","last_became_active":"2021-01-27T16:39:27.334141+0000","last_became_peered":"2021-01-27T16:39:27.334141+0000","last_unstale":"2021-01-27T16:40:25.378267+0000","last_undegraded":"2021-01-27T16:40:25.378267+0000","last_fullsized":"2021-01-27T16:40:25.378267+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380053+0000","last_change":"2021-01-27T16:39:04.566184+0000","last_active":"2021-01-27T16:40:25.380053+0000","last_peered":"2021-01-27T16:40:25.380053+0000","last_clean":"2021-01-27T16:40:25.380053+0000","last_became_active":"2021-01-27T16:39:04.565712+0000","last_became_peered":"2021-01-27T16:39:04.565712+0000","last_unstale":"2021-01-27T16:40:25.380053+0000","last_undegraded":"2021-01-27T16:40:25.380053+0000","last_fullsized":"2021-01-27T16:40:25.380053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"59'15","reported_seq":"46","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369070+0000","last_change":"2021-01-27T16:39:25.313156+0000","last_active":"2021-01-27T16:40:25.369070+0000","last_peered":"2021-01-27T16:40:25.369070+0000","last_clean":"2021-01-27T16:40:25.369070+0000","last_became_active":"2021-01-27T16:39:25.312611+0000","last_became_peered":"2021-01-27T16:39:25.312611+0000","last_unstale":"2021-01-27T16:40:25.369070+0000","last_undegraded":"2021-01-27T16:40:25.369070+0000","last_fullsized":"2021-01-27T16:40:25.369070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370301+0000","last_change":"2021-01-27T16:39:30.341596+0000","last_active":"2021-01-27T16:40:25.370301+0000","last_peered":"2021-01-27T16:40:25.370301+0000","last_clean":"2021-01-27T16:40:25.370301+0000","last_became_active":"2021-01-27T16:39:30.341165+0000","last_became_peered":"2021-01-27T16:39:30.341165+0000","last_unstale":"2021-01-27T16:40:25.370301+0000","last_undegraded":"2021-01-27T16:40:25.370301+0000","last_fullsized":"2021-01-27T16:40:25.370301+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388436+0000","last_change":"2021-01-27T16:39:27.343024+0000","last_active":"2021-01-27T16:40:25.388436+0000","last_peered":"2021-01-27T16:40:25.388436+0000","last_clean":"2021-01-27T16:40:25.388436+0000","last_became_active":"2021-01-27T16:39:27.342525+0000","last_became_peered":"2021-01-27T16:39:27.342525+0000","last_unstale":"2021-01-27T16:40:25.388436+0000","last_undegraded":"2021-01-27T16:40:25.388436+0000","last_fullsized":"2021-01-27T16:40:25.388436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389547+0000","last_change":"2021-01-27T16:39:08.603276+0000","last_active":"2021-01-27T16:40:25.389547+0000","last_peered":"2021-01-27T16:40:25.389547+0000","last_clean":"2021-01-27T16:40:25.389547+0000","last_became_active":"2021-01-27T16:39:08.600792+0000","last_became_peered":"2021-01-27T16:39:08.600792+0000","last_unstale":"2021-01-27T16:40:25.389547+0000","last_undegraded":"2021-01-27T16:40:25.389547+0000","last_fullsized":"2021-01-27T16:40:25.389547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"59'6","reported_seq":"30","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369780+0000","last_change":"2021-01-27T16:39:25.315715+0000","last_active":"2021-01-27T16:40:25.369780+0000","last_peered":"2021-01-27T16:40:25.369780+0000","last_clean":"2021-01-27T16:40:25.369780+0000","last_became_active":"2021-01-27T16:39:25.315191+0000","last_became_peered":"2021-01-27T16:39:25.315191+0000","last_unstale":"2021-01-27T16:40:25.369780+0000","last_undegraded":"2021-01-27T16:40:25.369780+0000","last_fullsized":"2021-01-27T16:40:25.369780+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386898+0000","last_change":"2021-01-27T16:39:30.344754+0000","last_active":"2021-01-27T16:40:25.386898+0000","last_peered":"2021-01-27T16:40:25.386898+0000","last_clean":"2021-01-27T16:40:25.386898+0000","last_became_active":"2021-01-27T16:39:30.343877+0000","last_became_peered":"2021-01-27T16:39:30.343877+0000","last_unstale":"2021-01-27T16:40:25.386898+0000","last_undegraded":"2021-01-27T16:40:25.386898+0000","last_fullsized":"2021-01-27T16:40:25.386898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371105+0000","last_change":"2021-01-27T16:39:27.331838+0000","last_active":"2021-01-27T16:40:25.371105+0000","last_peered":"2021-01-27T16:40:25.371105+0000","last_clean":"2021-01-27T16:40:25.371105+0000","last_became_active":"2021-01-27T16:39:27.331381+0000","last_became_peered":"2021-01-27T16:39:27.331381+0000","last_unstale":"2021-01-27T16:40:25.371105+0000","last_undegraded":"2021-01-27T16:40:25.371105+0000","last_fullsized":"2021-01-27T16:40:25.371105+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389247+0000","last_change":"2021-01-27T16:39:08.598987+0000","last_active":"2021-01-27T16:40:25.389247+0000","last_peered":"2021-01-27T16:40:25.389247+0000","last_clean":"2021-01-27T16:40:25.389247+0000","last_became_active":"2021-01-27T16:39:08.598511+0000","last_became_peered":"2021-01-27T16:39:08.598511+0000","last_unstale":"2021-01-27T16:40:25.389247+0000","last_undegraded":"2021-01-27T16:40:25.389247+0000","last_fullsized":"2021-01-27T16:40:25.389247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"59'13","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369638+0000","last_change":"2021-01-27T16:39:25.314193+0000","last_active":"2021-01-27T16:40:25.369638+0000","last_peered":"2021-01-27T16:40:25.369638+0000","last_clean":"2021-01-27T16:40:25.369638+0000","last_became_active":"2021-01-27T16:39:25.313757+0000","last_became_peered":"2021-01-27T16:39:25.313757+0000","last_unstale":"2021-01-27T16:40:25.369638+0000","last_undegraded":"2021-01-27T16:40:25.369638+0000","last_fullsized":"2021-01-27T16:40:25.369638+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377776+0000","last_change":"2021-01-27T16:39:30.469614+0000","last_active":"2021-01-27T16:40:25.377776+0000","last_peered":"2021-01-27T16:40:25.377776+0000","last_clean":"2021-01-27T16:40:25.377776+0000","last_became_active":"2021-01-27T16:39:30.463066+0000","last_became_peered":"2021-01-27T16:39:30.463066+0000","last_unstale":"2021-01-27T16:40:25.377776+0000","last_undegraded":"2021-01-27T16:40:25.377776+0000","last_fullsized":"2021-01-27T16:40:25.377776+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370667+0000","last_change":"2021-01-27T16:39:27.329920+0000","last_active":"2021-01-27T16:40:25.370667+0000","last_peered":"2021-01-27T16:40:25.370667+0000","last_clean":"2021-01-27T16:40:25.370667+0000","last_became_active":"2021-01-27T16:39:27.329539+0000","last_became_peered":"2021-01-27T16:39:27.329539+0000","last_unstale":"2021-01-27T16:40:25.370667+0000","last_undegraded":"2021-01-27T16:40:25.370667+0000","last_fullsized":"2021-01-27T16:40:25.370667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378301+0000","last_change":"2021-01-27T16:39:08.594067+0000","last_active":"2021-01-27T16:40:25.378301+0000","last_peered":"2021-01-27T16:40:25.378301+0000","last_clean":"2021-01-27T16:40:25.378301+0000","last_became_active":"2021-01-27T16:39:08.593660+0000","last_became_peered":"2021-01-27T16:39:08.593660+0000","last_unstale":"2021-01-27T16:40:25.378301+0000","last_undegraded":"2021-01-27T16:40:25.378301+0000","last_fullsized":"2021-01-27T16:40:25.378301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"59'16","reported_seq":"78","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.813469+0000","last_change":"2021-01-27T16:40:26.813469+0000","last_active":"2021-01-27T16:40:26.813469+0000","last_peered":"2021-01-27T16:40:26.813469+0000","last_clean":"2021-01-27T16:40:26.813469+0000","last_became_active":"2021-01-27T16:40:26.380690+0000","last_became_peered":"2021-01-27T16:40:26.380690+0000","last_unstale":"2021-01-27T16:40:26.813469+0000","last_undegraded":"2021-01-27T16:40:26.813469+0000","last_fullsized":"2021-01-27T16:40:26.813469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":20,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371499+0000","last_change":"2021-01-27T16:39:30.464556+0000","last_active":"2021-01-27T16:40:25.371499+0000","last_peered":"2021-01-27T16:40:25.371499+0000","last_clean":"2021-01-27T16:40:25.371499+0000","last_became_active":"2021-01-27T16:39:30.463929+0000","last_became_peered":"2021-01-27T16:39:30.463929+0000","last_unstale":"2021-01-27T16:40:25.371499+0000","last_undegraded":"2021-01-27T16:40:25.371499+0000","last_fullsized":"2021-01-27T16:40:25.371499+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379563+0000","last_change":"2021-01-27T16:39:27.343815+0000","last_active":"2021-01-27T16:40:25.379563+0000","last_peered":"2021-01-27T16:40:25.379563+0000","last_clean":"2021-01-27T16:40:25.379563+0000","last_became_active":"2021-01-27T16:39:27.343434+0000","last_became_peered":"2021-01-27T16:39:27.343434+0000","last_unstale":"2021-01-27T16:40:25.379563+0000","last_undegraded":"2021-01-27T16:40:25.379563+0000","last_fullsized":"2021-01-27T16:40:25.379563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368445+0000","last_change":"2021-01-27T16:39:08.595089+0000","last_active":"2021-01-27T16:40:25.368445+0000","last_peered":"2021-01-27T16:40:25.368445+0000","last_clean":"2021-01-27T16:40:25.368445+0000","last_became_active":"2021-01-27T16:39:08.594293+0000","last_became_peered":"2021-01-27T16:39:08.594293+0000","last_unstale":"2021-01-27T16:40:25.368445+0000","last_undegraded":"2021-01-27T16:40:25.368445+0000","last_fullsized":"2021-01-27T16:40:25.368445+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"59'15","reported_seq":"43","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379783+0000","last_change":"2021-01-27T16:39:25.315044+0000","last_active":"2021-01-27T16:40:25.379783+0000","last_peered":"2021-01-27T16:40:25.379783+0000","last_clean":"2021-01-27T16:40:25.379783+0000","last_became_active":"2021-01-27T16:39:25.314084+0000","last_became_peered":"2021-01-27T16:39:25.314084+0000","last_unstale":"2021-01-27T16:40:25.379783+0000","last_undegraded":"2021-01-27T16:40:25.379783+0000","last_fullsized":"2021-01-27T16:40:25.379783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378939+0000","last_change":"2021-01-27T16:39:30.342981+0000","last_active":"2021-01-27T16:40:25.378939+0000","last_peered":"2021-01-27T16:40:25.378939+0000","last_clean":"2021-01-27T16:40:25.378939+0000","last_became_active":"2021-01-27T16:39:30.342603+0000","last_became_peered":"2021-01-27T16:39:30.342603+0000","last_unstale":"2021-01-27T16:40:25.378939+0000","last_undegraded":"2021-01-27T16:40:25.378939+0000","last_fullsized":"2021-01-27T16:40:25.378939+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387478+0000","last_change":"2021-01-27T16:39:27.340214+0000","last_active":"2021-01-27T16:40:25.387478+0000","last_peered":"2021-01-27T16:40:25.387478+0000","last_clean":"2021-01-27T16:40:25.387478+0000","last_became_active":"2021-01-27T16:39:27.339696+0000","last_became_peered":"2021-01-27T16:39:27.339696+0000","last_unstale":"2021-01-27T16:40:25.387478+0000","last_undegraded":"2021-01-27T16:40:25.387478+0000","last_fullsized":"2021-01-27T16:40:25.387478+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377586+0000","last_change":"2021-01-27T16:39:04.565598+0000","last_active":"2021-01-27T16:40:25.377586+0000","last_peered":"2021-01-27T16:40:25.377586+0000","last_clean":"2021-01-27T16:40:25.377586+0000","last_became_active":"2021-01-27T16:39:04.565126+0000","last_became_peered":"2021-01-27T16:39:04.565126+0000","last_unstale":"2021-01-27T16:40:25.377586+0000","last_undegraded":"2021-01-27T16:40:25.377586+0000","last_fullsized":"2021-01-27T16:40:25.377586+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"59'17","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369391+0000","last_change":"2021-01-27T16:39:25.316721+0000","last_active":"2021-01-27T16:40:25.369391+0000","last_peered":"2021-01-27T16:40:25.369391+0000","last_clean":"2021-01-27T16:40:25.369391+0000","last_became_active":"2021-01-27T16:39:25.316275+0000","last_became_peered":"2021-01-27T16:39:25.316275+0000","last_unstale":"2021-01-27T16:40:25.369391+0000","last_undegraded":"2021-01-27T16:40:25.369391+0000","last_fullsized":"2021-01-27T16:40:25.369391+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":19,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389554+0000","last_change":"2021-01-27T16:39:30.337510+0000","last_active":"2021-01-27T16:40:25.389554+0000","last_peered":"2021-01-27T16:40:25.389554+0000","last_clean":"2021-01-27T16:40:25.389554+0000","last_became_active":"2021-01-27T16:39:30.337051+0000","last_became_peered":"2021-01-27T16:39:30.337051+0000","last_unstale":"2021-01-27T16:40:25.389554+0000","last_undegraded":"2021-01-27T16:40:25.389554+0000","last_fullsized":"2021-01-27T16:40:25.389554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.342255+0000","last_change":"2021-01-27T16:39:27.333271+0000","last_active":"2021-01-27T16:42:13.342255+0000","last_peered":"2021-01-27T16:42:13.342255+0000","last_clean":"2021-01-27T16:42:13.342255+0000","last_became_active":"2021-01-27T16:39:27.331940+0000","last_became_peered":"2021-01-27T16:39:27.331940+0000","last_unstale":"2021-01-27T16:42:13.342255+0000","last_undegraded":"2021-01-27T16:42:13.342255+0000","last_fullsized":"2021-01-27T16:42:13.342255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369996+0000","last_change":"2021-01-27T16:39:08.594952+0000","last_active":"2021-01-27T16:40:25.369996+0000","last_peered":"2021-01-27T16:40:25.369996+0000","last_clean":"2021-01-27T16:40:25.369996+0000","last_became_active":"2021-01-27T16:39:08.594087+0000","last_became_peered":"2021-01-27T16:39:08.594087+0000","last_unstale":"2021-01-27T16:40:25.369996+0000","last_undegraded":"2021-01-27T16:40:25.369996+0000","last_fullsized":"2021-01-27T16:40:25.369996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"59'16","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387393+0000","last_change":"2021-01-27T16:39:25.775439+0000","last_active":"2021-01-27T16:40:25.387393+0000","last_peered":"2021-01-27T16:40:25.387393+0000","last_clean":"2021-01-27T16:40:25.387393+0000","last_became_active":"2021-01-27T16:39:25.774705+0000","last_became_peered":"2021-01-27T16:39:25.774705+0000","last_unstale":"2021-01-27T16:40:25.387393+0000","last_undegraded":"2021-01-27T16:40:25.387393+0000","last_fullsized":"2021-01-27T16:40:25.387393+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378666+0000","last_change":"2021-01-27T16:39:30.466847+0000","last_active":"2021-01-27T16:40:25.378666+0000","last_peered":"2021-01-27T16:40:25.378666+0000","last_clean":"2021-01-27T16:40:25.378666+0000","last_became_active":"2021-01-27T16:39:30.464291+0000","last_became_peered":"2021-01-27T16:39:30.464291+0000","last_unstale":"2021-01-27T16:40:25.378666+0000","last_undegraded":"2021-01-27T16:40:25.378666+0000","last_fullsized":"2021-01-27T16:40:25.378666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388477+0000","last_change":"2021-01-27T16:39:27.342649+0000","last_active":"2021-01-27T16:40:25.388477+0000","last_peered":"2021-01-27T16:40:25.388477+0000","last_clean":"2021-01-27T16:40:25.388477+0000","last_became_active":"2021-01-27T16:39:27.341991+0000","last_became_peered":"2021-01-27T16:39:27.341991+0000","last_unstale":"2021-01-27T16:40:25.388477+0000","last_undegraded":"2021-01-27T16:40:25.388477+0000","last_fullsized":"2021-01-27T16:40:25.388477+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'3","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369512+0000","last_change":"2021-01-27T16:39:07.783274+0000","last_active":"2021-01-27T16:40:25.369512+0000","last_peered":"2021-01-27T16:40:25.369512+0000","last_clean":"2021-01-27T16:40:25.369512+0000","last_became_active":"2021-01-27T16:39:07.589253+0000","last_became_peered":"2021-01-27T16:39:07.589253+0000","last_unstale":"2021-01-27T16:40:25.369512+0000","last_undegraded":"2021-01-27T16:40:25.369512+0000","last_fullsized":"2021-01-27T16:40:25.369512+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":151,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"59'14","reported_seq":"43","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377983+0000","last_change":"2021-01-27T16:39:25.773006+0000","last_active":"2021-01-27T16:40:25.377983+0000","last_peered":"2021-01-27T16:40:25.377983+0000","last_clean":"2021-01-27T16:40:25.377983+0000","last_became_active":"2021-01-27T16:39:25.771745+0000","last_became_peered":"2021-01-27T16:39:25.771745+0000","last_unstale":"2021-01-27T16:40:25.377983+0000","last_undegraded":"2021-01-27T16:40:25.377983+0000","last_fullsized":"2021-01-27T16:40:25.377983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":16,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388186+0000","last_change":"2021-01-27T16:39:30.337576+0000","last_active":"2021-01-27T16:40:25.388186+0000","last_peered":"2021-01-27T16:40:25.388186+0000","last_clean":"2021-01-27T16:40:25.388186+0000","last_became_active":"2021-01-27T16:39:30.337039+0000","last_became_peered":"2021-01-27T16:39:30.337039+0000","last_unstale":"2021-01-27T16:40:25.388186+0000","last_undegraded":"2021-01-27T16:40:25.388186+0000","last_fullsized":"2021-01-27T16:40:25.388186+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368226+0000","last_change":"2021-01-27T16:39:27.331890+0000","last_active":"2021-01-27T16:40:25.368226+0000","last_peered":"2021-01-27T16:40:25.368226+0000","last_clean":"2021-01-27T16:40:25.368226+0000","last_became_active":"2021-01-27T16:39:27.331383+0000","last_became_peered":"2021-01-27T16:39:27.331383+0000","last_unstale":"2021-01-27T16:40:25.368226+0000","last_undegraded":"2021-01-27T16:40:25.368226+0000","last_fullsized":"2021-01-27T16:40:25.368226+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374289+0000","last_change":"2021-01-27T16:39:04.558104+0000","last_active":"2021-01-27T16:40:25.374289+0000","last_peered":"2021-01-27T16:40:25.374289+0000","last_clean":"2021-01-27T16:40:25.374289+0000","last_became_active":"2021-01-27T16:39:04.557713+0000","last_became_peered":"2021-01-27T16:39:04.557713+0000","last_unstale":"2021-01-27T16:40:25.374289+0000","last_undegraded":"2021-01-27T16:40:25.374289+0000","last_fullsized":"2021-01-27T16:40:25.374289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"59'12","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377401+0000","last_change":"2021-01-27T16:39:25.322950+0000","last_active":"2021-01-27T16:40:25.377401+0000","last_peered":"2021-01-27T16:40:25.377401+0000","last_clean":"2021-01-27T16:40:25.377401+0000","last_became_active":"2021-01-27T16:39:25.322683+0000","last_became_peered":"2021-01-27T16:39:25.322683+0000","last_unstale":"2021-01-27T16:40:25.377401+0000","last_undegraded":"2021-01-27T16:40:25.377401+0000","last_fullsized":"2021-01-27T16:40:25.377401+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377369+0000","last_change":"2021-01-27T16:39:30.353494+0000","last_active":"2021-01-27T16:40:25.377369+0000","last_peered":"2021-01-27T16:40:25.377369+0000","last_clean":"2021-01-27T16:40:25.377369+0000","last_became_active":"2021-01-27T16:39:30.353102+0000","last_became_peered":"2021-01-27T16:39:30.353102+0000","last_unstale":"2021-01-27T16:40:25.377369+0000","last_undegraded":"2021-01-27T16:40:25.377369+0000","last_fullsized":"2021-01-27T16:40:25.377369+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378997+0000","last_change":"2021-01-27T16:39:27.335611+0000","last_active":"2021-01-27T16:40:25.378997+0000","last_peered":"2021-01-27T16:40:25.378997+0000","last_clean":"2021-01-27T16:40:25.378997+0000","last_became_active":"2021-01-27T16:39:27.335157+0000","last_became_peered":"2021-01-27T16:39:27.335157+0000","last_unstale":"2021-01-27T16:40:25.378997+0000","last_undegraded":"2021-01-27T16:40:25.378997+0000","last_fullsized":"2021-01-27T16:40:25.378997+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"45'1","reported_seq":"27","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379176+0000","last_change":"2021-01-27T16:39:04.570724+0000","last_active":"2021-01-27T16:40:25.379176+0000","last_peered":"2021-01-27T16:40:25.379176+0000","last_clean":"2021-01-27T16:40:25.379176+0000","last_became_active":"2021-01-27T16:39:04.570339+0000","last_became_peered":"2021-01-27T16:39:04.570339+0000","last_unstale":"2021-01-27T16:40:25.379176+0000","last_undegraded":"2021-01-27T16:40:25.379176+0000","last_fullsized":"2021-01-27T16:40:25.379176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"59'15","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370023+0000","last_change":"2021-01-27T16:39:25.312882+0000","last_active":"2021-01-27T16:40:25.370023+0000","last_peered":"2021-01-27T16:40:25.370023+0000","last_clean":"2021-01-27T16:40:25.370023+0000","last_became_active":"2021-01-27T16:39:25.312440+0000","last_became_peered":"2021-01-27T16:39:25.312440+0000","last_unstale":"2021-01-27T16:40:25.370023+0000","last_undegraded":"2021-01-27T16:40:25.370023+0000","last_fullsized":"2021-01-27T16:40:25.370023+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385861+0000","last_change":"2021-01-27T16:39:30.352345+0000","last_active":"2021-01-27T16:40:25.385861+0000","last_peered":"2021-01-27T16:40:25.385861+0000","last_clean":"2021-01-27T16:40:25.385861+0000","last_became_active":"2021-01-27T16:39:30.351397+0000","last_became_peered":"2021-01-27T16:39:30.351397+0000","last_unstale":"2021-01-27T16:40:25.385861+0000","last_undegraded":"2021-01-27T16:40:25.385861+0000","last_fullsized":"2021-01-27T16:40:25.385861+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378500+0000","last_change":"2021-01-27T16:39:27.337834+0000","last_active":"2021-01-27T16:40:25.378500+0000","last_peered":"2021-01-27T16:40:25.378500+0000","last_clean":"2021-01-27T16:40:25.378500+0000","last_became_active":"2021-01-27T16:39:27.337546+0000","last_became_peered":"2021-01-27T16:39:27.337546+0000","last_unstale":"2021-01-27T16:40:25.378500+0000","last_undegraded":"2021-01-27T16:40:25.378500+0000","last_fullsized":"2021-01-27T16:40:25.378500+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369065+0000","last_change":"2021-01-27T16:39:04.551936+0000","last_active":"2021-01-27T16:40:25.369065+0000","last_peered":"2021-01-27T16:40:25.369065+0000","last_clean":"2021-01-27T16:40:25.369065+0000","last_became_active":"2021-01-27T16:39:04.550706+0000","last_became_peered":"2021-01-27T16:39:04.550706+0000","last_unstale":"2021-01-27T16:40:25.369065+0000","last_undegraded":"2021-01-27T16:40:25.369065+0000","last_fullsized":"2021-01-27T16:40:25.369065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"59'15","reported_seq":"46","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378752+0000","last_change":"2021-01-27T16:39:25.313876+0000","last_active":"2021-01-27T16:40:25.378752+0000","last_peered":"2021-01-27T16:40:25.378752+0000","last_clean":"2021-01-27T16:40:25.378752+0000","last_became_active":"2021-01-27T16:39:25.313506+0000","last_became_peered":"2021-01-27T16:39:25.313506+0000","last_unstale":"2021-01-27T16:40:25.378752+0000","last_undegraded":"2021-01-27T16:40:25.378752+0000","last_fullsized":"2021-01-27T16:40:25.378752+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371423+0000","last_change":"2021-01-27T16:39:30.341986+0000","last_active":"2021-01-27T16:40:25.371423+0000","last_peered":"2021-01-27T16:40:25.371423+0000","last_clean":"2021-01-27T16:40:25.371423+0000","last_became_active":"2021-01-27T16:39:30.341553+0000","last_became_peered":"2021-01-27T16:39:30.341553+0000","last_unstale":"2021-01-27T16:40:25.371423+0000","last_undegraded":"2021-01-27T16:40:25.371423+0000","last_fullsized":"2021-01-27T16:40:25.371423+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340348+0000","last_change":"2021-01-27T16:39:27.331142+0000","last_active":"2021-01-27T16:42:13.340348+0000","last_peered":"2021-01-27T16:42:13.340348+0000","last_clean":"2021-01-27T16:42:13.340348+0000","last_became_active":"2021-01-27T16:39:27.330561+0000","last_became_peered":"2021-01-27T16:39:27.330561+0000","last_unstale":"2021-01-27T16:42:13.340348+0000","last_undegraded":"2021-01-27T16:42:13.340348+0000","last_fullsized":"2021-01-27T16:42:13.340348+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386564+0000","last_change":"2021-01-27T16:39:04.573517+0000","last_active":"2021-01-27T16:40:25.386564+0000","last_peered":"2021-01-27T16:40:25.386564+0000","last_clean":"2021-01-27T16:40:25.386564+0000","last_became_active":"2021-01-27T16:39:04.573056+0000","last_became_peered":"2021-01-27T16:39:04.573056+0000","last_unstale":"2021-01-27T16:40:25.386564+0000","last_undegraded":"2021-01-27T16:40:25.386564+0000","last_fullsized":"2021-01-27T16:40:25.386564+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"59'13","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373611+0000","last_change":"2021-01-27T16:39:25.775397+0000","last_active":"2021-01-27T16:40:25.373611+0000","last_peered":"2021-01-27T16:40:25.373611+0000","last_clean":"2021-01-27T16:40:25.373611+0000","last_became_active":"2021-01-27T16:39:25.774995+0000","last_became_peered":"2021-01-27T16:39:25.774995+0000","last_unstale":"2021-01-27T16:40:25.373611+0000","last_undegraded":"2021-01-27T16:40:25.373611+0000","last_fullsized":"2021-01-27T16:40:25.373611+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":15,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386482+0000","last_change":"2021-01-27T16:39:30.351394+0000","last_active":"2021-01-27T16:40:25.386482+0000","last_peered":"2021-01-27T16:40:25.386482+0000","last_clean":"2021-01-27T16:40:25.386482+0000","last_became_active":"2021-01-27T16:39:30.350970+0000","last_became_peered":"2021-01-27T16:39:30.350970+0000","last_unstale":"2021-01-27T16:40:25.386482+0000","last_undegraded":"2021-01-27T16:40:25.386482+0000","last_fullsized":"2021-01-27T16:40:25.386482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.342250+0000","last_change":"2021-01-27T16:39:27.337005+0000","last_active":"2021-01-27T16:42:13.342250+0000","last_peered":"2021-01-27T16:42:13.342250+0000","last_clean":"2021-01-27T16:42:13.342250+0000","last_became_active":"2021-01-27T16:39:27.336523+0000","last_became_peered":"2021-01-27T16:39:27.336523+0000","last_unstale":"2021-01-27T16:42:13.342250+0000","last_undegraded":"2021-01-27T16:42:13.342250+0000","last_fullsized":"2021-01-27T16:42:13.342250+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370515+0000","last_change":"2021-01-27T16:39:08.653875+0000","last_active":"2021-01-27T16:40:25.370515+0000","last_peered":"2021-01-27T16:40:25.370515+0000","last_clean":"2021-01-27T16:40:25.370515+0000","last_became_active":"2021-01-27T16:39:08.595314+0000","last_became_peered":"2021-01-27T16:39:08.595314+0000","last_unstale":"2021-01-27T16:40:25.370515+0000","last_undegraded":"2021-01-27T16:40:25.370515+0000","last_fullsized":"2021-01-27T16:40:25.370515+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"59'14","reported_seq":"41","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378913+0000","last_change":"2021-01-27T16:39:25.772514+0000","last_active":"2021-01-27T16:40:25.378913+0000","last_peered":"2021-01-27T16:40:25.378913+0000","last_clean":"2021-01-27T16:40:25.378913+0000","last_became_active":"2021-01-27T16:39:25.771418+0000","last_became_peered":"2021-01-27T16:39:25.771418+0000","last_unstale":"2021-01-27T16:40:25.378913+0000","last_undegraded":"2021-01-27T16:40:25.378913+0000","last_fullsized":"2021-01-27T16:40:25.378913+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":14,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389393+0000","last_change":"2021-01-27T16:39:30.464170+0000","last_active":"2021-01-27T16:40:25.389393+0000","last_peered":"2021-01-27T16:40:25.389393+0000","last_clean":"2021-01-27T16:40:25.389393+0000","last_became_active":"2021-01-27T16:39:30.463773+0000","last_became_peered":"2021-01-27T16:39:30.463773+0000","last_unstale":"2021-01-27T16:40:25.389393+0000","last_undegraded":"2021-01-27T16:40:25.389393+0000","last_fullsized":"2021-01-27T16:40:25.389393+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374244+0000","last_change":"2021-01-27T16:39:27.327942+0000","last_active":"2021-01-27T16:40:25.374244+0000","last_peered":"2021-01-27T16:40:25.374244+0000","last_clean":"2021-01-27T16:40:25.374244+0000","last_became_active":"2021-01-27T16:39:27.327519+0000","last_became_peered":"2021-01-27T16:39:27.327519+0000","last_unstale":"2021-01-27T16:40:25.374244+0000","last_undegraded":"2021-01-27T16:40:25.374244+0000","last_fullsized":"2021-01-27T16:40:25.374244+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"49'1","reported_seq":"26","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368398+0000","last_change":"2021-01-27T16:39:04.551499+0000","last_active":"2021-01-27T16:40:25.368398+0000","last_peered":"2021-01-27T16:40:25.368398+0000","last_clean":"2021-01-27T16:40:25.368398+0000","last_became_active":"2021-01-27T16:39:04.551183+0000","last_became_peered":"2021-01-27T16:39:04.551183+0000","last_unstale":"2021-01-27T16:40:25.368398+0000","last_undegraded":"2021-01-27T16:40:25.368398+0000","last_fullsized":"2021-01-27T16:40:25.368398+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"59'7","reported_seq":"29","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377685+0000","last_change":"2021-01-27T16:39:25.772853+0000","last_active":"2021-01-27T16:40:25.377685+0000","last_peered":"2021-01-27T16:40:25.377685+0000","last_clean":"2021-01-27T16:40:25.377685+0000","last_became_active":"2021-01-27T16:39:25.771810+0000","last_became_peered":"2021-01-27T16:39:25.771810+0000","last_unstale":"2021-01-27T16:40:25.377685+0000","last_undegraded":"2021-01-27T16:40:25.377685+0000","last_fullsized":"2021-01-27T16:40:25.377685+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379479+0000","last_change":"2021-01-27T16:39:30.342746+0000","last_active":"2021-01-27T16:40:25.379479+0000","last_peered":"2021-01-27T16:40:25.379479+0000","last_clean":"2021-01-27T16:40:25.379479+0000","last_became_active":"2021-01-27T16:39:30.342349+0000","last_became_peered":"2021-01-27T16:39:30.342349+0000","last_unstale":"2021-01-27T16:40:25.379479+0000","last_undegraded":"2021-01-27T16:40:25.379479+0000","last_fullsized":"2021-01-27T16:40:25.379479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377964+0000","last_change":"2021-01-27T16:39:27.339358+0000","last_active":"2021-01-27T16:40:25.377964+0000","last_peered":"2021-01-27T16:40:25.377964+0000","last_clean":"2021-01-27T16:40:25.377964+0000","last_became_active":"2021-01-27T16:39:27.338947+0000","last_became_peered":"2021-01-27T16:39:27.338947+0000","last_unstale":"2021-01-27T16:40:25.377964+0000","last_undegraded":"2021-01-27T16:40:25.377964+0000","last_fullsized":"2021-01-27T16:40:25.377964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"49'2","reported_seq":"28","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376625+0000","last_change":"2021-01-27T16:39:04.564492+0000","last_active":"2021-01-27T16:40:25.376625+0000","last_peered":"2021-01-27T16:40:25.376625+0000","last_clean":"2021-01-27T16:40:25.376625+0000","last_became_active":"2021-01-27T16:39:04.564060+0000","last_became_peered":"2021-01-27T16:39:04.564060+0000","last_unstale":"2021-01-27T16:40:25.376625+0000","last_undegraded":"2021-01-27T16:40:25.376625+0000","last_fullsized":"2021-01-27T16:40:25.376625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"59'16","reported_seq":"48","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387169+0000","last_change":"2021-01-27T16:39:25.775954+0000","last_active":"2021-01-27T16:40:25.387169+0000","last_peered":"2021-01-27T16:40:25.387169+0000","last_clean":"2021-01-27T16:40:25.387169+0000","last_became_active":"2021-01-27T16:39:25.775204+0000","last_became_peered":"2021-01-27T16:39:25.775204+0000","last_unstale":"2021-01-27T16:40:25.387169+0000","last_undegraded":"2021-01-27T16:40:25.387169+0000","last_fullsized":"2021-01-27T16:40:25.387169+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":38,"num_read_kb":18,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378586+0000","last_change":"2021-01-27T16:39:30.355162+0000","last_active":"2021-01-27T16:40:25.378586+0000","last_peered":"2021-01-27T16:40:25.378586+0000","last_clean":"2021-01-27T16:40:25.378586+0000","last_became_active":"2021-01-27T16:39:30.354840+0000","last_became_peered":"2021-01-27T16:39:30.354840+0000","last_unstale":"2021-01-27T16:40:25.378586+0000","last_undegraded":"2021-01-27T16:40:25.378586+0000","last_fullsized":"2021-01-27T16:40:25.378586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"49'2","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371686+0000","last_change":"2021-01-27T16:39:08.595414+0000","last_active":"2021-01-27T16:40:25.371686+0000","last_peered":"2021-01-27T16:40:25.371686+0000","last_clean":"2021-01-27T16:40:25.371686+0000","last_became_active":"2021-01-27T16:39:08.594999+0000","last_became_peered":"2021-01-27T16:39:08.594999+0000","last_unstale":"2021-01-27T16:40:25.371686+0000","last_undegraded":"2021-01-27T16:40:25.371686+0000","last_fullsized":"2021-01-27T16:40:25.371686+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"59'15","reported_seq":"47","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369295+0000","last_change":"2021-01-27T16:39:25.316865+0000","last_active":"2021-01-27T16:40:25.369295+0000","last_peered":"2021-01-27T16:40:25.369295+0000","last_clean":"2021-01-27T16:40:25.369295+0000","last_became_active":"2021-01-27T16:39:25.316442+0000","last_became_peered":"2021-01-27T16:39:25.316442+0000","last_unstale":"2021-01-27T16:40:25.369295+0000","last_undegraded":"2021-01-27T16:40:25.369295+0000","last_fullsized":"2021-01-27T16:40:25.369295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":19,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376528+0000","last_change":"2021-01-27T16:39:27.331086+0000","last_active":"2021-01-27T16:40:25.376528+0000","last_peered":"2021-01-27T16:40:25.376528+0000","last_clean":"2021-01-27T16:40:25.376528+0000","last_became_active":"2021-01-27T16:39:27.330564+0000","last_became_peered":"2021-01-27T16:39:27.330564+0000","last_unstale":"2021-01-27T16:40:25.376528+0000","last_undegraded":"2021-01-27T16:40:25.376528+0000","last_fullsized":"2021-01-27T16:40:25.376528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385982+0000","last_change":"2021-01-27T16:39:30.350390+0000","last_active":"2021-01-27T16:40:25.385982+0000","last_peered":"2021-01-27T16:40:25.385982+0000","last_clean":"2021-01-27T16:40:25.385982+0000","last_became_active":"2021-01-27T16:39:30.349967+0000","last_became_peered":"2021-01-27T16:39:30.349967+0000","last_unstale":"2021-01-27T16:40:25.385982+0000","last_undegraded":"2021-01-27T16:40:25.385982+0000","last_fullsized":"2021-01-27T16:40:25.385982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.382066+0000","last_change":"2021-01-27T16:39:08.595257+0000","last_active":"2021-01-27T16:40:25.382066+0000","last_peered":"2021-01-27T16:40:25.382066+0000","last_clean":"2021-01-27T16:40:25.382066+0000","last_became_active":"2021-01-27T16:39:08.594542+0000","last_became_peered":"2021-01-27T16:39:08.594542+0000","last_unstale":"2021-01-27T16:40:25.382066+0000","last_undegraded":"2021-01-27T16:40:25.382066+0000","last_fullsized":"2021-01-27T16:40:25.382066+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'16","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378885+0000","last_change":"2021-01-27T16:39:25.312971+0000","last_active":"2021-01-27T16:40:25.378885+0000","last_peered":"2021-01-27T16:40:25.378885+0000","last_clean":"2021-01-27T16:40:25.378885+0000","last_became_active":"2021-01-27T16:39:25.310984+0000","last_became_peered":"2021-01-27T16:39:25.310984+0000","last_unstale":"2021-01-27T16:40:25.378885+0000","last_undegraded":"2021-01-27T16:40:25.378885+0000","last_fullsized":"2021-01-27T16:40:25.378885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":33,"num_read_kb":16,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340380+0000","last_change":"2021-01-27T16:39:27.333407+0000","last_active":"2021-01-27T16:42:13.340380+0000","last_peered":"2021-01-27T16:42:13.340380+0000","last_clean":"2021-01-27T16:42:13.340380+0000","last_became_active":"2021-01-27T16:39:27.332807+0000","last_became_peered":"2021-01-27T16:39:27.332807+0000","last_unstale":"2021-01-27T16:42:13.340380+0000","last_undegraded":"2021-01-27T16:42:13.340380+0000","last_fullsized":"2021-01-27T16:42:13.340380+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380109+0000","last_change":"2021-01-27T16:39:30.351940+0000","last_active":"2021-01-27T16:40:25.380109+0000","last_peered":"2021-01-27T16:40:25.380109+0000","last_clean":"2021-01-27T16:40:25.380109+0000","last_became_active":"2021-01-27T16:39:30.351552+0000","last_became_peered":"2021-01-27T16:39:30.351552+0000","last_unstale":"2021-01-27T16:40:25.380109+0000","last_undegraded":"2021-01-27T16:40:25.380109+0000","last_fullsized":"2021-01-27T16:40:25.380109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370625+0000","last_change":"2021-01-27T16:39:04.553471+0000","last_active":"2021-01-27T16:40:25.370625+0000","last_peered":"2021-01-27T16:40:25.370625+0000","last_clean":"2021-01-27T16:40:25.370625+0000","last_became_active":"2021-01-27T16:39:04.550623+0000","last_became_peered":"2021-01-27T16:39:04.550623+0000","last_unstale":"2021-01-27T16:40:25.370625+0000","last_undegraded":"2021-01-27T16:40:25.370625+0000","last_fullsized":"2021-01-27T16:40:25.370625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"59'25","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:28.080228+0000","last_change":"2021-01-27T16:40:28.080228+0000","last_active":"2021-01-27T16:40:28.080228+0000","last_peered":"2021-01-27T16:40:28.080228+0000","last_clean":"2021-01-27T16:40:28.080228+0000","last_became_active":"2021-01-27T16:40:26.387484+0000","last_became_peered":"2021-01-27T16:40:26.387484+0000","last_unstale":"2021-01-27T16:40:28.080228+0000","last_undegraded":"2021-01-27T16:40:28.080228+0000","last_fullsized":"2021-01-27T16:40:28.080228+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":54,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386525+0000","last_change":"2021-01-27T16:39:27.341972+0000","last_active":"2021-01-27T16:40:25.386525+0000","last_peered":"2021-01-27T16:40:25.386525+0000","last_clean":"2021-01-27T16:40:25.386525+0000","last_became_active":"2021-01-27T16:39:27.341582+0000","last_became_peered":"2021-01-27T16:39:27.341582+0000","last_unstale":"2021-01-27T16:40:25.386525+0000","last_undegraded":"2021-01-27T16:40:25.386525+0000","last_fullsized":"2021-01-27T16:40:25.386525+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389681+0000","last_change":"2021-01-27T16:39:30.465041+0000","last_active":"2021-01-27T16:40:25.389681+0000","last_peered":"2021-01-27T16:40:25.389681+0000","last_clean":"2021-01-27T16:40:25.389681+0000","last_became_active":"2021-01-27T16:39:30.463215+0000","last_became_peered":"2021-01-27T16:39:30.463215+0000","last_unstale":"2021-01-27T16:40:25.389681+0000","last_undegraded":"2021-01-27T16:40:25.389681+0000","last_fullsized":"2021-01-27T16:40:25.389681+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"59'5","reported_seq":"191","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:23.940497+0000","last_change":"2021-01-27T16:39:24.300166+0000","last_active":"2021-01-27T16:42:23.940497+0000","last_peered":"2021-01-27T16:42:23.940497+0000","last_clean":"2021-01-27T16:42:23.940497+0000","last_became_active":"2021-01-27T16:39:24.299781+0000","last_became_peered":"2021-01-27T16:39:24.299781+0000","last_unstale":"2021-01-27T16:42:23.940497+0000","last_undegraded":"2021-01-27T16:42:23.940497+0000","last_fullsized":"2021-01-27T16:42:23.940497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":164,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"45'1","reported_seq":"28","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.376932+0000","last_change":"2021-01-27T16:39:04.571835+0000","last_active":"2021-01-27T16:40:25.376932+0000","last_peered":"2021-01-27T16:40:25.376932+0000","last_clean":"2021-01-27T16:40:25.376932+0000","last_became_active":"2021-01-27T16:39:04.571379+0000","last_became_peered":"2021-01-27T16:39:04.571379+0000","last_unstale":"2021-01-27T16:40:25.376932+0000","last_undegraded":"2021-01-27T16:40:25.376932+0000","last_fullsized":"2021-01-27T16:40:25.376932+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"59'15","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379279+0000","last_change":"2021-01-27T16:39:25.309752+0000","last_active":"2021-01-27T16:40:25.379279+0000","last_peered":"2021-01-27T16:40:25.379279+0000","last_clean":"2021-01-27T16:40:25.379279+0000","last_became_active":"2021-01-27T16:39:25.309361+0000","last_became_peered":"2021-01-27T16:39:25.309361+0000","last_unstale":"2021-01-27T16:40:25.379279+0000","last_undegraded":"2021-01-27T16:40:25.379279+0000","last_fullsized":"2021-01-27T16:40:25.379279+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":21,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378482+0000","last_change":"2021-01-27T16:39:27.338731+0000","last_active":"2021-01-27T16:40:25.378482+0000","last_peered":"2021-01-27T16:40:25.378482+0000","last_clean":"2021-01-27T16:40:25.378482+0000","last_became_active":"2021-01-27T16:39:27.338189+0000","last_became_peered":"2021-01-27T16:39:27.338189+0000","last_unstale":"2021-01-27T16:40:25.378482+0000","last_undegraded":"2021-01-27T16:40:25.378482+0000","last_fullsized":"2021-01-27T16:40:25.378482+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374079+0000","last_change":"2021-01-27T16:39:30.349530+0000","last_active":"2021-01-27T16:40:25.374079+0000","last_peered":"2021-01-27T16:40:25.374079+0000","last_clean":"2021-01-27T16:40:25.374079+0000","last_became_active":"2021-01-27T16:39:30.349110+0000","last_became_peered":"2021-01-27T16:39:30.349110+0000","last_unstale":"2021-01-27T16:40:25.374079+0000","last_undegraded":"2021-01-27T16:40:25.374079+0000","last_fullsized":"2021-01-27T16:40:25.374079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.380251+0000","last_change":"2021-01-27T16:39:24.303331+0000","last_active":"2021-01-27T16:40:25.380251+0000","last_peered":"2021-01-27T16:40:25.380251+0000","last_clean":"2021-01-27T16:40:25.380251+0000","last_became_active":"2021-01-27T16:39:24.302844+0000","last_became_peered":"2021-01-27T16:39:24.302844+0000","last_unstale":"2021-01-27T16:40:25.380251+0000","last_undegraded":"2021-01-27T16:40:25.380251+0000","last_fullsized":"2021-01-27T16:40:25.380251+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"49'2","reported_seq":"40","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.372943+0000","last_change":"2021-01-27T16:39:08.596240+0000","last_active":"2021-01-27T16:40:25.372943+0000","last_peered":"2021-01-27T16:40:25.372943+0000","last_clean":"2021-01-27T16:40:25.372943+0000","last_became_active":"2021-01-27T16:39:08.595001+0000","last_became_peered":"2021-01-27T16:39:08.595001+0000","last_unstale":"2021-01-27T16:40:25.372943+0000","last_undegraded":"2021-01-27T16:40:25.372943+0000","last_fullsized":"2021-01-27T16:40:25.372943+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388298+0000","last_change":"2021-01-27T16:39:08.607545+0000","last_active":"2021-01-27T16:40:25.388298+0000","last_peered":"2021-01-27T16:40:25.388298+0000","last_clean":"2021-01-27T16:40:25.388298+0000","last_became_active":"2021-01-27T16:39:08.607230+0000","last_became_peered":"2021-01-27T16:39:08.607230+0000","last_unstale":"2021-01-27T16:40:25.388298+0000","last_undegraded":"2021-01-27T16:40:25.388298+0000","last_fullsized":"2021-01-27T16:40:25.388298+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:34:20.937701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:34:20.937701+0000","last_clean_scrub_stamp":"2021-01-27T16:34:20.937701+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"59'15","reported_seq":"42","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369657+0000","last_change":"2021-01-27T16:39:25.775168+0000","last_active":"2021-01-27T16:40:25.369657+0000","last_peered":"2021-01-27T16:40:25.369657+0000","last_clean":"2021-01-27T16:40:25.369657+0000","last_became_active":"2021-01-27T16:39:25.774575+0000","last_became_peered":"2021-01-27T16:39:25.774575+0000","last_unstale":"2021-01-27T16:40:25.369657+0000","last_undegraded":"2021-01-27T16:40:25.369657+0000","last_fullsized":"2021-01-27T16:40:25.369657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389376+0000","last_change":"2021-01-27T16:39:27.333511+0000","last_active":"2021-01-27T16:40:25.389376+0000","last_peered":"2021-01-27T16:40:25.389376+0000","last_clean":"2021-01-27T16:40:25.389376+0000","last_became_active":"2021-01-27T16:39:27.333080+0000","last_became_peered":"2021-01-27T16:39:27.333080+0000","last_unstale":"2021-01-27T16:40:25.389376+0000","last_undegraded":"2021-01-27T16:40:25.389376+0000","last_fullsized":"2021-01-27T16:40:25.389376+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381984+0000","last_change":"2021-01-27T16:39:30.349032+0000","last_active":"2021-01-27T16:40:25.381984+0000","last_peered":"2021-01-27T16:40:25.381984+0000","last_clean":"2021-01-27T16:40:25.381984+0000","last_became_active":"2021-01-27T16:39:30.348631+0000","last_became_peered":"2021-01-27T16:39:30.348631+0000","last_unstale":"2021-01-27T16:40:25.381984+0000","last_undegraded":"2021-01-27T16:40:25.381984+0000","last_fullsized":"2021-01-27T16:40:25.381984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386074+0000","last_change":"2021-01-27T16:39:24.305069+0000","last_active":"2021-01-27T16:40:25.386074+0000","last_peered":"2021-01-27T16:40:25.386074+0000","last_clean":"2021-01-27T16:40:25.386074+0000","last_became_active":"2021-01-27T16:39:24.304700+0000","last_became_peered":"2021-01-27T16:39:24.304700+0000","last_unstale":"2021-01-27T16:40:25.386074+0000","last_undegraded":"2021-01-27T16:40:25.386074+0000","last_fullsized":"2021-01-27T16:40:25.386074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:23.263141+0000","last_clean_scrub_stamp":"2021-01-27T16:39:23.263141+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"49'1","reported_seq":"14","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.386574+0000","last_change":"2021-01-27T16:40:26.386574+0000","last_active":"2021-01-27T16:40:26.386574+0000","last_peered":"2021-01-27T16:40:26.386574+0000","last_clean":"2021-01-27T16:40:26.386574+0000","last_became_active":"2021-01-27T16:40:26.380985+0000","last_became_peered":"2021-01-27T16:40:26.380985+0000","last_unstale":"2021-01-27T16:40:26.386574+0000","last_undegraded":"2021-01-27T16:40:26.386574+0000","last_fullsized":"2021-01-27T16:40:26.386574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"59'16","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387066+0000","last_change":"2021-01-27T16:39:25.311555+0000","last_active":"2021-01-27T16:40:25.387066+0000","last_peered":"2021-01-27T16:40:25.387066+0000","last_clean":"2021-01-27T16:40:25.387066+0000","last_became_active":"2021-01-27T16:39:25.311153+0000","last_became_peered":"2021-01-27T16:39:25.311153+0000","last_unstale":"2021-01-27T16:40:25.387066+0000","last_undegraded":"2021-01-27T16:40:25.387066+0000","last_fullsized":"2021-01-27T16:40:25.387066+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.374029+0000","last_change":"2021-01-27T16:39:27.331577+0000","last_active":"2021-01-27T16:40:25.374029+0000","last_peered":"2021-01-27T16:40:25.374029+0000","last_clean":"2021-01-27T16:40:25.374029+0000","last_became_active":"2021-01-27T16:39:27.331172+0000","last_became_peered":"2021-01-27T16:39:27.331172+0000","last_unstale":"2021-01-27T16:40:25.374029+0000","last_undegraded":"2021-01-27T16:40:25.374029+0000","last_fullsized":"2021-01-27T16:40:25.374029+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378185+0000","last_change":"2021-01-27T16:39:30.465615+0000","last_active":"2021-01-27T16:40:25.378185+0000","last_peered":"2021-01-27T16:40:25.378185+0000","last_clean":"2021-01-27T16:40:25.378185+0000","last_became_active":"2021-01-27T16:39:30.464407+0000","last_became_peered":"2021-01-27T16:39:30.464407+0000","last_unstale":"2021-01-27T16:40:25.378185+0000","last_undegraded":"2021-01-27T16:40:25.378185+0000","last_fullsized":"2021-01-27T16:40:25.378185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389473+0000","last_change":"2021-01-27T16:39:08.601875+0000","last_active":"2021-01-27T16:40:25.389473+0000","last_peered":"2021-01-27T16:40:25.389473+0000","last_clean":"2021-01-27T16:40:25.389473+0000","last_became_active":"2021-01-27T16:39:08.601381+0000","last_became_peered":"2021-01-27T16:39:08.601381+0000","last_unstale":"2021-01-27T16:40:25.389473+0000","last_undegraded":"2021-01-27T16:40:25.389473+0000","last_fullsized":"2021-01-27T16:40:25.389473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"59'21","reported_seq":"58","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386319+0000","last_change":"2021-01-27T16:39:25.772557+0000","last_active":"2021-01-27T16:40:25.386319+0000","last_peered":"2021-01-27T16:40:25.386319+0000","last_clean":"2021-01-27T16:40:25.386319+0000","last_became_active":"2021-01-27T16:39:25.771666+0000","last_became_peered":"2021-01-27T16:39:25.771666+0000","last_unstale":"2021-01-27T16:40:25.386319+0000","last_undegraded":"2021-01-27T16:40:25.386319+0000","last_fullsized":"2021-01-27T16:40:25.386319+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368336+0000","last_change":"2021-01-27T16:39:27.328927+0000","last_active":"2021-01-27T16:40:25.368336+0000","last_peered":"2021-01-27T16:40:25.368336+0000","last_clean":"2021-01-27T16:40:25.368336+0000","last_became_active":"2021-01-27T16:39:27.328402+0000","last_became_peered":"2021-01-27T16:39:27.328402+0000","last_unstale":"2021-01-27T16:40:25.368336+0000","last_undegraded":"2021-01-27T16:40:25.368336+0000","last_fullsized":"2021-01-27T16:40:25.368336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370092+0000","last_change":"2021-01-27T16:39:30.342418+0000","last_active":"2021-01-27T16:40:25.370092+0000","last_peered":"2021-01-27T16:40:25.370092+0000","last_clean":"2021-01-27T16:40:25.370092+0000","last_became_active":"2021-01-27T16:39:30.341956+0000","last_became_peered":"2021-01-27T16:39:30.341956+0000","last_unstale":"2021-01-27T16:40:25.370092+0000","last_undegraded":"2021-01-27T16:40:25.370092+0000","last_fullsized":"2021-01-27T16:40:25.370092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381956+0000","last_change":"2021-01-27T16:39:07.593638+0000","last_active":"2021-01-27T16:40:25.381956+0000","last_peered":"2021-01-27T16:40:25.381956+0000","last_clean":"2021-01-27T16:40:25.381956+0000","last_became_active":"2021-01-27T16:39:07.593064+0000","last_became_peered":"2021-01-27T16:39:07.593064+0000","last_unstale":"2021-01-27T16:40:25.381956+0000","last_undegraded":"2021-01-27T16:40:25.381956+0000","last_fullsized":"2021-01-27T16:40:25.381956+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'22","reported_seq":"58","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377221+0000","last_change":"2021-01-27T16:39:25.773801+0000","last_active":"2021-01-27T16:40:25.377221+0000","last_peered":"2021-01-27T16:40:25.377221+0000","last_clean":"2021-01-27T16:40:25.377221+0000","last_became_active":"2021-01-27T16:39:25.772701+0000","last_became_peered":"2021-01-27T16:39:25.772701+0000","last_unstale":"2021-01-27T16:40:25.377221+0000","last_undegraded":"2021-01-27T16:40:25.377221+0000","last_fullsized":"2021-01-27T16:40:25.377221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":26,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369519+0000","last_change":"2021-01-27T16:39:27.340087+0000","last_active":"2021-01-27T16:40:25.369519+0000","last_peered":"2021-01-27T16:40:25.369519+0000","last_clean":"2021-01-27T16:40:25.369519+0000","last_became_active":"2021-01-27T16:39:27.339688+0000","last_became_peered":"2021-01-27T16:39:27.339688+0000","last_unstale":"2021-01-27T16:40:25.369519+0000","last_undegraded":"2021-01-27T16:40:25.369519+0000","last_fullsized":"2021-01-27T16:40:25.369519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.389119+0000","last_change":"2021-01-27T16:39:30.464726+0000","last_active":"2021-01-27T16:40:25.389119+0000","last_peered":"2021-01-27T16:40:25.389119+0000","last_clean":"2021-01-27T16:40:25.389119+0000","last_became_active":"2021-01-27T16:39:30.464282+0000","last_became_peered":"2021-01-27T16:39:30.464282+0000","last_unstale":"2021-01-27T16:40:25.389119+0000","last_undegraded":"2021-01-27T16:40:25.389119+0000","last_fullsized":"2021-01-27T16:40:25.389119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"33","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369717+0000","last_change":"2021-01-27T16:39:08.597548+0000","last_active":"2021-01-27T16:40:25.369717+0000","last_peered":"2021-01-27T16:40:25.369717+0000","last_clean":"2021-01-27T16:40:25.369717+0000","last_became_active":"2021-01-27T16:39:08.597006+0000","last_became_peered":"2021-01-27T16:39:08.597006+0000","last_unstale":"2021-01-27T16:40:25.369717+0000","last_undegraded":"2021-01-27T16:40:25.369717+0000","last_fullsized":"2021-01-27T16:40:25.369717+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"59'20","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.369298+0000","last_change":"2021-01-27T16:39:25.303835+0000","last_active":"2021-01-27T16:40:25.369298+0000","last_peered":"2021-01-27T16:40:25.369298+0000","last_clean":"2021-01-27T16:40:25.369298+0000","last_became_active":"2021-01-27T16:39:25.303179+0000","last_became_peered":"2021-01-27T16:39:25.303179+0000","last_unstale":"2021-01-27T16:40:25.369298+0000","last_undegraded":"2021-01-27T16:40:25.369298+0000","last_fullsized":"2021-01-27T16:40:25.369298+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":39,"num_read_kb":20,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.340108+0000","last_change":"2021-01-27T16:39:27.337919+0000","last_active":"2021-01-27T16:42:13.340108+0000","last_peered":"2021-01-27T16:42:13.340108+0000","last_clean":"2021-01-27T16:42:13.340108+0000","last_became_active":"2021-01-27T16:39:27.337354+0000","last_became_peered":"2021-01-27T16:39:27.337354+0000","last_unstale":"2021-01-27T16:42:13.340108+0000","last_undegraded":"2021-01-27T16:42:13.340108+0000","last_fullsized":"2021-01-27T16:42:13.340108+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378826+0000","last_change":"2021-01-27T16:39:30.464611+0000","last_active":"2021-01-27T16:40:25.378826+0000","last_peered":"2021-01-27T16:40:25.378826+0000","last_clean":"2021-01-27T16:40:25.378826+0000","last_became_active":"2021-01-27T16:39:30.463527+0000","last_became_peered":"2021-01-27T16:39:30.463527+0000","last_unstale":"2021-01-27T16:40:25.378826+0000","last_undegraded":"2021-01-27T16:40:25.378826+0000","last_fullsized":"2021-01-27T16:40:25.378826+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373948+0000","last_change":"2021-01-27T16:39:27.322395+0000","last_active":"2021-01-27T16:40:25.373948+0000","last_peered":"2021-01-27T16:40:25.373948+0000","last_clean":"2021-01-27T16:40:25.373948+0000","last_became_active":"2021-01-27T16:39:27.321905+0000","last_became_peered":"2021-01-27T16:39:27.321905+0000","last_unstale":"2021-01-27T16:40:25.373948+0000","last_undegraded":"2021-01-27T16:40:25.373948+0000","last_fullsized":"2021-01-27T16:40:25.373948+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"22","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.388351+0000","last_change":"2021-01-27T16:39:08.608737+0000","last_active":"2021-01-27T16:40:25.388351+0000","last_peered":"2021-01-27T16:40:25.388351+0000","last_clean":"2021-01-27T16:40:25.388351+0000","last_became_active":"2021-01-27T16:39:08.608246+0000","last_became_peered":"2021-01-27T16:39:08.608246+0000","last_unstale":"2021-01-27T16:40:25.388351+0000","last_undegraded":"2021-01-27T16:40:25.388351+0000","last_fullsized":"2021-01-27T16:40:25.388351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"59'15","reported_seq":"74","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:40:26.839854+0000","last_change":"2021-01-27T16:40:26.839854+0000","last_active":"2021-01-27T16:40:26.839854+0000","last_peered":"2021-01-27T16:40:26.839854+0000","last_clean":"2021-01-27T16:40:26.839854+0000","last_became_active":"2021-01-27T16:40:26.383437+0000","last_became_peered":"2021-01-27T16:40:26.383437+0000","last_unstale":"2021-01-27T16:40:26.839854+0000","last_undegraded":"2021-01-27T16:40:26.839854+0000","last_fullsized":"2021-01-27T16:40:26.839854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.373123+0000","last_change":"2021-01-27T16:39:30.344007+0000","last_active":"2021-01-27T16:40:25.373123+0000","last_peered":"2021-01-27T16:40:25.373123+0000","last_clean":"2021-01-27T16:40:25.373123+0000","last_became_active":"2021-01-27T16:39:30.343634+0000","last_became_peered":"2021-01-27T16:39:30.343634+0000","last_unstale":"2021-01-27T16:40:25.373123+0000","last_undegraded":"2021-01-27T16:40:25.373123+0000","last_fullsized":"2021-01-27T16:40:25.373123+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"54'2","reported_seq":"54","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:18.346796+0000","last_change":"2021-01-27T16:39:27.341333+0000","last_active":"2021-01-27T16:42:18.346796+0000","last_peered":"2021-01-27T16:42:18.346796+0000","last_clean":"2021-01-27T16:42:18.346796+0000","last_became_active":"2021-01-27T16:39:27.340018+0000","last_became_peered":"2021-01-27T16:39:27.340018+0000","last_unstale":"2021-01-27T16:42:18.346796+0000","last_undegraded":"2021-01-27T16:42:18.346796+0000","last_fullsized":"2021-01-27T16:42:18.346796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378408+0000","last_change":"2021-01-27T16:39:08.595810+0000","last_active":"2021-01-27T16:40:25.378408+0000","last_peered":"2021-01-27T16:40:25.378408+0000","last_clean":"2021-01-27T16:40:25.378408+0000","last_became_active":"2021-01-27T16:39:08.595407+0000","last_became_peered":"2021-01-27T16:39:08.595407+0000","last_unstale":"2021-01-27T16:40:25.378408+0000","last_undegraded":"2021-01-27T16:40:25.378408+0000","last_fullsized":"2021-01-27T16:40:25.378408+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"59'17","reported_seq":"47","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379193+0000","last_change":"2021-01-27T16:39:25.317994+0000","last_active":"2021-01-27T16:40:25.379193+0000","last_peered":"2021-01-27T16:40:25.379193+0000","last_clean":"2021-01-27T16:40:25.379193+0000","last_became_active":"2021-01-27T16:39:25.317534+0000","last_became_peered":"2021-01-27T16:39:25.317534+0000","last_unstale":"2021-01-27T16:40:25.379193+0000","last_undegraded":"2021-01-27T16:40:25.379193+0000","last_fullsized":"2021-01-27T16:40:25.379193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370994+0000","last_change":"2021-01-27T16:39:30.340757+0000","last_active":"2021-01-27T16:40:25.370994+0000","last_peered":"2021-01-27T16:40:25.370994+0000","last_clean":"2021-01-27T16:40:25.370994+0000","last_became_active":"2021-01-27T16:39:30.340317+0000","last_became_peered":"2021-01-27T16:39:30.340317+0000","last_unstale":"2021-01-27T16:40:25.370994+0000","last_undegraded":"2021-01-27T16:40:25.370994+0000","last_fullsized":"2021-01-27T16:40:25.370994+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"54'2","reported_seq":"54","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:18.344465+0000","last_change":"2021-01-27T16:39:27.336376+0000","last_active":"2021-01-27T16:42:18.344465+0000","last_peered":"2021-01-27T16:42:18.344465+0000","last_clean":"2021-01-27T16:42:18.344465+0000","last_became_active":"2021-01-27T16:39:27.335859+0000","last_became_peered":"2021-01-27T16:39:27.335859+0000","last_unstale":"2021-01-27T16:42:18.344465+0000","last_undegraded":"2021-01-27T16:42:18.344465+0000","last_fullsized":"2021-01-27T16:42:18.344465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378623+0000","last_change":"2021-01-27T16:39:08.601817+0000","last_active":"2021-01-27T16:40:25.378623+0000","last_peered":"2021-01-27T16:40:25.378623+0000","last_clean":"2021-01-27T16:40:25.378623+0000","last_became_active":"2021-01-27T16:39:08.601173+0000","last_became_peered":"2021-01-27T16:39:08.601173+0000","last_unstale":"2021-01-27T16:40:25.378623+0000","last_undegraded":"2021-01-27T16:40:25.378623+0000","last_fullsized":"2021-01-27T16:40:25.378623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'13","reported_seq":"39","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370398+0000","last_change":"2021-01-27T16:39:25.314448+0000","last_active":"2021-01-27T16:40:25.370398+0000","last_peered":"2021-01-27T16:40:25.370398+0000","last_clean":"2021-01-27T16:40:25.370398+0000","last_became_active":"2021-01-27T16:39:25.313946+0000","last_became_peered":"2021-01-27T16:39:25.313946+0000","last_unstale":"2021-01-27T16:40:25.370398+0000","last_undegraded":"2021-01-27T16:40:25.370398+0000","last_fullsized":"2021-01-27T16:40:25.370398+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378202+0000","last_change":"2021-01-27T16:39:30.345305+0000","last_active":"2021-01-27T16:40:25.378202+0000","last_peered":"2021-01-27T16:40:25.378202+0000","last_clean":"2021-01-27T16:40:25.378202+0000","last_became_active":"2021-01-27T16:39:30.344919+0000","last_became_peered":"2021-01-27T16:39:30.344919+0000","last_unstale":"2021-01-27T16:40:25.378202+0000","last_undegraded":"2021-01-27T16:40:25.378202+0000","last_fullsized":"2021-01-27T16:40:25.378202+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.381865+0000","last_change":"2021-01-27T16:39:27.334639+0000","last_active":"2021-01-27T16:40:25.381865+0000","last_peered":"2021-01-27T16:40:25.381865+0000","last_clean":"2021-01-27T16:40:25.381865+0000","last_became_active":"2021-01-27T16:39:27.334228+0000","last_became_peered":"2021-01-27T16:39:27.334228+0000","last_unstale":"2021-01-27T16:40:25.381865+0000","last_undegraded":"2021-01-27T16:40:25.381865+0000","last_fullsized":"2021-01-27T16:40:25.381865+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"59'2","reported_seq":"60","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:12.658369+0000","last_change":"2021-01-27T16:39:08.611674+0000","last_active":"2021-01-27T16:42:12.658369+0000","last_peered":"2021-01-27T16:42:12.658369+0000","last_clean":"2021-01-27T16:42:12.658369+0000","last_became_active":"2021-01-27T16:39:08.599410+0000","last_became_peered":"2021-01-27T16:39:08.599410+0000","last_unstale":"2021-01-27T16:42:12.658369+0000","last_undegraded":"2021-01-27T16:42:12.658369+0000","last_fullsized":"2021-01-27T16:42:12.658369+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"59'21","reported_seq":"54","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.371733+0000","last_change":"2021-01-27T16:39:25.311693+0000","last_active":"2021-01-27T16:40:25.371733+0000","last_peered":"2021-01-27T16:40:25.371733+0000","last_clean":"2021-01-27T16:40:25.371733+0000","last_became_active":"2021-01-27T16:39:25.311253+0000","last_became_peered":"2021-01-27T16:39:25.311253+0000","last_unstale":"2021-01-27T16:40:25.371733+0000","last_undegraded":"2021-01-27T16:40:25.371733+0000","last_fullsized":"2021-01-27T16:40:25.371733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.387560+0000","last_change":"2021-01-27T16:39:30.349014+0000","last_active":"2021-01-27T16:40:25.387560+0000","last_peered":"2021-01-27T16:40:25.387560+0000","last_clean":"2021-01-27T16:40:25.387560+0000","last_became_active":"2021-01-27T16:39:30.348621+0000","last_became_peered":"2021-01-27T16:39:30.348621+0000","last_unstale":"2021-01-27T16:40:25.387560+0000","last_undegraded":"2021-01-27T16:40:25.387560+0000","last_fullsized":"2021-01-27T16:40:25.387560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377703+0000","last_change":"2021-01-27T16:39:27.329575+0000","last_active":"2021-01-27T16:40:25.377703+0000","last_peered":"2021-01-27T16:40:25.377703+0000","last_clean":"2021-01-27T16:40:25.377703+0000","last_became_active":"2021-01-27T16:39:27.328955+0000","last_became_peered":"2021-01-27T16:39:27.328955+0000","last_unstale":"2021-01-27T16:40:25.377703+0000","last_undegraded":"2021-01-27T16:40:25.377703+0000","last_fullsized":"2021-01-27T16:40:25.377703+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"25","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379638+0000","last_change":"2021-01-27T16:39:04.566323+0000","last_active":"2021-01-27T16:40:25.379638+0000","last_peered":"2021-01-27T16:40:25.379638+0000","last_clean":"2021-01-27T16:40:25.379638+0000","last_became_active":"2021-01-27T16:39:04.565281+0000","last_became_peered":"2021-01-27T16:39:04.565281+0000","last_unstale":"2021-01-27T16:40:25.379638+0000","last_undegraded":"2021-01-27T16:40:25.379638+0000","last_fullsized":"2021-01-27T16:40:25.379638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'23","reported_seq":"57","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.368227+0000","last_change":"2021-01-27T16:39:25.774483+0000","last_active":"2021-01-27T16:40:25.368227+0000","last_peered":"2021-01-27T16:40:25.368227+0000","last_clean":"2021-01-27T16:40:25.368227+0000","last_became_active":"2021-01-27T16:39:25.773490+0000","last_became_peered":"2021-01-27T16:39:25.773490+0000","last_unstale":"2021-01-27T16:40:25.368227+0000","last_undegraded":"2021-01-27T16:40:25.368227+0000","last_fullsized":"2021-01-27T16:40:25.368227+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":44,"num_read_kb":25,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.385945+0000","last_change":"2021-01-27T16:39:30.340744+0000","last_active":"2021-01-27T16:40:25.385945+0000","last_peered":"2021-01-27T16:40:25.385945+0000","last_clean":"2021-01-27T16:40:25.385945+0000","last_became_active":"2021-01-27T16:39:30.340312+0000","last_became_peered":"2021-01-27T16:39:30.340312+0000","last_unstale":"2021-01-27T16:40:25.385945+0000","last_undegraded":"2021-01-27T16:40:25.385945+0000","last_fullsized":"2021-01-27T16:40:25.385945+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.377450+0000","last_change":"2021-01-27T16:39:27.324829+0000","last_active":"2021-01-27T16:40:25.377450+0000","last_peered":"2021-01-27T16:40:25.377450+0000","last_clean":"2021-01-27T16:40:25.377450+0000","last_became_active":"2021-01-27T16:39:27.324323+0000","last_became_peered":"2021-01-27T16:39:27.324323+0000","last_unstale":"2021-01-27T16:40:25.377450+0000","last_undegraded":"2021-01-27T16:40:25.377450+0000","last_fullsized":"2021-01-27T16:40:25.377450+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.379086+0000","last_change":"2021-01-27T16:39:04.559602+0000","last_active":"2021-01-27T16:40:25.379086+0000","last_peered":"2021-01-27T16:40:25.379086+0000","last_clean":"2021-01-27T16:40:25.379086+0000","last_became_active":"2021-01-27T16:39:04.559170+0000","last_became_peered":"2021-01-27T16:39:04.559170+0000","last_unstale":"2021-01-27T16:40:25.379086+0000","last_undegraded":"2021-01-27T16:40:25.379086+0000","last_fullsized":"2021-01-27T16:40:25.379086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"59'14","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.386705+0000","last_change":"2021-01-27T16:39:25.312485+0000","last_active":"2021-01-27T16:40:25.386705+0000","last_peered":"2021-01-27T16:40:25.386705+0000","last_clean":"2021-01-27T16:40:25.386705+0000","last_became_active":"2021-01-27T16:39:25.312117+0000","last_became_peered":"2021-01-27T16:39:25.312117+0000","last_unstale":"2021-01-27T16:40:25.386705+0000","last_undegraded":"2021-01-27T16:40:25.386705+0000","last_fullsized":"2021-01-27T16:40:25.386705+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":16,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370443+0000","last_change":"2021-01-27T16:39:30.465944+0000","last_active":"2021-01-27T16:40:25.370443+0000","last_peered":"2021-01-27T16:40:25.370443+0000","last_clean":"2021-01-27T16:40:25.370443+0000","last_became_active":"2021-01-27T16:39:30.465516+0000","last_became_peered":"2021-01-27T16:39:30.465516+0000","last_unstale":"2021-01-27T16:40:25.370443+0000","last_undegraded":"2021-01-27T16:40:25.370443+0000","last_fullsized":"2021-01-27T16:40:25.370443+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:29.308464+0000","last_clean_scrub_stamp":"2021-01-27T16:39:29.308464+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"34","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.378370+0000","last_change":"2021-01-27T16:39:08.595828+0000","last_active":"2021-01-27T16:40:25.378370+0000","last_peered":"2021-01-27T16:40:25.378370+0000","last_clean":"2021-01-27T16:40:25.378370+0000","last_became_active":"2021-01-27T16:39:08.594390+0000","last_became_peered":"2021-01-27T16:39:08.594390+0000","last_unstale":"2021-01-27T16:40:25.378370+0000","last_undegraded":"2021-01-27T16:40:25.378370+0000","last_fullsized":"2021-01-27T16:40:25.378370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:03.522460+0000","last_clean_scrub_stamp":"2021-01-27T16:39:03.522460+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'18","reported_seq":"49","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-27T16:40:25.370222+0000","last_change":"2021-01-27T16:39:25.773041+0000","last_active":"2021-01-27T16:40:25.370222+0000","last_peered":"2021-01-27T16:40:25.370222+0000","last_clean":"2021-01-27T16:40:25.370222+0000","last_became_active":"2021-01-27T16:39:25.771788+0000","last_became_peered":"2021-01-27T16:39:25.771788+0000","last_unstale":"2021-01-27T16:40:25.370222+0000","last_undegraded":"2021-01-27T16:40:25.370222+0000","last_fullsized":"2021-01-27T16:40:25.370222+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:24.273785+0000","last_clean_scrub_stamp":"2021-01-27T16:39:24.273785+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":20,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"54'2","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-27T16:42:13.342195+0000","last_change":"2021-01-27T16:39:27.344696+0000","last_active":"2021-01-27T16:42:13.342195+0000","last_peered":"2021-01-27T16:42:13.342195+0000","last_clean":"2021-01-27T16:42:13.342195+0000","last_became_active":"2021-01-27T16:39:27.344394+0000","last_became_peered":"2021-01-27T16:39:27.344394+0000","last_unstale":"2021-01-27T16:42:13.342195+0000","last_undegraded":"2021-01-27T16:42:13.342195+0000","last_fullsized":"2021-01-27T16:42:13.342195+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-27T16:39:26.299759+0000","last_clean_scrub_stamp":"2021-01-27T16:39:26.299759+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":1069,"num_read_kb":574,"num_write":542,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":2536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":510,"ondisk_log_size":510,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":164,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":313,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430249,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6144,"kb_used_data":824,"kb_used_omap":0,"kb_used_meta":5312,"kb_avail":93739008,"statfs":{"total":95995035648,"available":95988744192,"internally_reserved":0,"allocated":843776,"data_stored":287712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5439488},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.206,"15min":2.246},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.8839999999999999,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.722},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.032,"15min":1.9670000000000001},"min":{"1min":1.3129999999999999,"5min":1.234,"15min":1.234},"max":{"1min":3.6429999999999998,"5min":4.117,"15min":4.117},"last":1.96}]},{"osd":1,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.2890000000000001,"5min":2.351,"15min":2.3719999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":3.5289999999999999,"5min":5.2949999999999999,"15min":5.2949999999999999},"last":2.133},{"interface":"front","average":{"1min":2.4460000000000002,"5min":2.552,"15min":2.5739999999999998},"min":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":2.7629999999999999}]},{"osd":2,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":2.2570000000000001,"15min":2.2970000000000002},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.177,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":2.6280000000000001},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.9609999999999999,"15min":3.085},"min":{"1min":1.397,"5min":1.397,"15min":1.397},"max":{"1min":3.7650000000000001,"5min":7.8230000000000004,"15min":7.8230000000000004},"last":2.5129999999999999}]},{"osd":3,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":2.5760000000000001,"15min":2.6120000000000001},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":3.375,"5min":4.6189999999999998,"15min":4.6189999999999998},"last":2.2669999999999999},{"interface":"front","average":{"1min":3.04,"5min":3.2360000000000002,"15min":3.3439999999999999},"min":{"1min":1.264,"5min":1.264,"15min":1.264},"max":{"1min":3.8769999999999998,"5min":8.7799999999999994,"15min":8.7799999999999994},"last":2.9009999999999998}]},{"osd":4,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.1539999999999999,"5min":2.9430000000000001,"15min":2.867},"min":{"1min":1.353,"5min":1.3520000000000001,"15min":1.3520000000000001},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":4.4409999999999998},"last":2.423},{"interface":"front","average":{"1min":2.899,"5min":2.9409999999999998,"15min":2.9780000000000002},"min":{"1min":1.474,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":3.7650000000000001,"5min":7.2169999999999996,"15min":7.2169999999999996},"last":3.0230000000000001}]},{"osd":5,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.3809999999999998,"5min":3.2679999999999998,"15min":3.226},"min":{"1min":1.52,"5min":1.52,"15min":1.52},"max":{"1min":4.3559999999999999,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.157},{"interface":"front","average":{"1min":3.3639999999999999,"5min":3.2770000000000001,"15min":3.2269999999999999},"min":{"1min":1.6839999999999999,"5min":1.593,"15min":1.593},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":4.4459999999999997},"last":3.23}]},{"osd":6,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.5960000000000001,"5min":3.556,"15min":3.5449999999999999},"min":{"1min":1.7869999999999999,"5min":1.343,"15min":1.343},"max":{"1min":4.6870000000000003,"5min":6.3410000000000002,"15min":6.3410000000000002},"last":3.6680000000000001},{"interface":"front","average":{"1min":3.379,"5min":3.54,"15min":3.6120000000000001},"min":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"max":{"1min":4.3280000000000003,"5min":8.282,"15min":8.282},"last":3.4710000000000001}]}]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6320,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738832,"statfs":{"total":95995035648,"available":95988563968,"internally_reserved":0,"allocated":892928,"data_stored":289027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.9219999999999999,"15min":1.8979999999999999},"min":{"1min":1.103,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.98,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.663},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.0899999999999999,"15min":2.032},"min":{"1min":1.4730000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"max":{"1min":3.1899999999999999,"5min":4.0739999999999998,"15min":4.0739999999999998},"last":1.7450000000000001}]},{"osd":1,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1280000000000001},"min":{"1min":1.514,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":4.5960000000000001,"5min":4.8090000000000002,"15min":4.8090000000000002},"last":1.867},{"interface":"front","average":{"1min":2.5339999999999998,"5min":2.427,"15min":2.4180000000000001},"min":{"1min":1.5860000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"max":{"1min":3.6230000000000002,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":2.2080000000000002}]},{"osd":2,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.4350000000000001,"5min":2.399,"15min":2.383},"min":{"1min":1.641,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":3.871,"5min":3.911,"15min":3.911},"last":2.5099999999999998},{"interface":"front","average":{"1min":2.794,"5min":2.6349999999999998,"15min":2.6280000000000001},"min":{"1min":1.8029999999999999,"5min":1.413,"15min":1.413},"max":{"1min":5.1260000000000003,"5min":5.1260000000000003,"15min":5.1260000000000003},"last":3.0099999999999998}]},{"osd":3,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.7450000000000001,"5min":2.5379999999999998,"15min":2.4620000000000002},"min":{"1min":1.6359999999999999,"5min":1.357,"15min":1.357},"max":{"1min":3.8130000000000002,"5min":4.7610000000000001,"15min":4.7610000000000001},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.9980000000000002,"5min":2.7709999999999999,"15min":2.7389999999999999},"min":{"1min":2.0249999999999999,"5min":1.492,"15min":1.492},"max":{"1min":4.6479999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":2.7309999999999999}]},{"osd":4,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":2.9079999999999999,"5min":2.7290000000000001,"15min":2.6150000000000002},"min":{"1min":2.081,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":4.4969999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":2.6349999999999998},{"interface":"front","average":{"1min":3.1000000000000001,"5min":2.859,"15min":2.7679999999999998},"min":{"1min":2.1019999999999999,"5min":1.663,"15min":1.663},"max":{"1min":4.1200000000000001,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":2.8490000000000002}]},{"osd":5,"last update":"Wed Jan 27 16:41:39 2021","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":2.9660000000000002,"15min":2.8679999999999999},"min":{"1min":2.4350000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"max":{"1min":4.2990000000000004,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":3.4260000000000002},{"interface":"front","average":{"1min":3.3719999999999999,"5min":3.137,"15min":3.0539999999999998},"min":{"1min":2.133,"5min":1.952,"15min":1.952},"max":{"1min":4.9409999999999998,"5min":5.3109999999999999,"15min":5.3109999999999999},"last":3.25}]},{"osd":7,"last update":"Wed Jan 27 16:42:10 2021","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.5649999999999999,"15min":3.5600000000000001},"min":{"1min":2.5539999999999998,"5min":2.1230000000000002,"15min":2.1230000000000002},"max":{"1min":4.7089999999999996,"5min":4.7279999999999998,"15min":4.7279999999999998},"last":3.7909999999999999},{"interface":"front","average":{"1min":3.8180000000000001,"5min":3.6120000000000001,"15min":3.5950000000000002},"min":{"1min":2.8980000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"max":{"1min":5.109,"5min":5.46,"15min":5.46},"last":3.6320000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476814,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6712,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738440,"statfs":{"total":95995035648,"available":95988162560,"internally_reserved":0,"allocated":966656,"data_stored":291320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:23 2021","interfaces":[{"interface":"back","average":{"1min":2.056,"5min":1.905,"15min":1.5369999999999999},"min":{"1min":1.1140000000000001,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":3.129,"5min":3.222,"15min":3.222},"last":2.4580000000000002},{"interface":"front","average":{"1min":2.0950000000000002,"5min":1.9890000000000001,"15min":1.631},"min":{"1min":0.98099999999999998,"5min":0.93100000000000005,"15min":0.59999999999999998},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":2.1600000000000001}]},{"osd":2,"last update":"Wed Jan 27 16:41:46 2021","interfaces":[{"interface":"back","average":{"1min":2.2189999999999999,"5min":2.1000000000000001,"15min":1.825},"min":{"1min":1.411,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.8260000000000001,"5min":4.2400000000000002,"15min":4.2400000000000002},"last":1.5620000000000001},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.2639999999999998,"15min":2.0649999999999999},"min":{"1min":1.302,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.2829999999999999,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":1.6850000000000001}]},{"osd":3,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":2.5569999999999999,"5min":2.4790000000000001,"15min":2.3849999999999998},"min":{"1min":1.8080000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.1000000000000001,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":2.8100000000000001},{"interface":"front","average":{"1min":2.294,"5min":2.2789999999999999,"15min":2.1749999999999998},"min":{"1min":1.456,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.9820000000000002,"5min":4.359,"15min":4.359},"last":2.2629999999999999}]},{"osd":4,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":2.4870000000000001,"15min":2.4900000000000002},"min":{"1min":1.607,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":3.0880000000000001,"5min":3.637,"15min":3.637},"last":2.5640000000000001},{"interface":"front","average":{"1min":2.9359999999999999,"5min":2.8919999999999999,"15min":2.778},"min":{"1min":1.7350000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":3.5870000000000002,"5min":4.7210000000000001,"15min":4.7210000000000001},"last":2.8639999999999999}]},{"osd":5,"last update":"Wed Jan 27 16:42:07 2021","interfaces":[{"interface":"back","average":{"1min":3.1880000000000002,"5min":3.1779999999999999,"15min":3.0339999999999998},"min":{"1min":2.1669999999999998,"5min":1.599,"15min":1.599},"max":{"1min":3.9340000000000002,"5min":5.6630000000000003,"15min":5.6630000000000003},"last":3.1389999999999998},{"interface":"front","average":{"1min":3.266,"5min":3.1779999999999999,"15min":3.0819999999999999},"min":{"1min":2.5379999999999998,"5min":1.6279999999999999,"15min":1.6279999999999999},"max":{"1min":4.1079999999999997,"5min":4.6900000000000004,"15min":4.6900000000000004},"last":2.6059999999999999}]},{"osd":6,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":2.9830000000000001,"15min":2.9809999999999999},"min":{"1min":1.8180000000000001,"5min":1.47,"15min":1.47},"max":{"1min":3.6709999999999998,"5min":5.0919999999999996,"15min":5.0919999999999996},"last":2.75},{"interface":"front","average":{"1min":3.4929999999999999,"5min":3.4409999999999998,"15min":3.379},"min":{"1min":2.3679999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"max":{"1min":4.1589999999999998,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":3.3610000000000002}]},{"osd":7,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":3.2959999999999998,"5min":3.29,"15min":3.3039999999999998},"min":{"1min":2.351,"5min":2.351,"15min":2.351},"max":{"1min":3.9929999999999999,"5min":5.3810000000000002,"15min":5.3810000000000002},"last":2.9319999999999999},{"interface":"front","average":{"1min":3.7320000000000002,"5min":3.7090000000000001,"15min":3.6739999999999999},"min":{"1min":2.7450000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"max":{"1min":4.3810000000000002,"5min":6.9690000000000003,"15min":6.9690000000000003},"last":3.585}]}]},{"osd":0,"up_from":10,"seq":42949673043,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6472,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738680,"statfs":{"total":95995035648,"available":95988408320,"internally_reserved":0,"allocated":851968,"data_stored":287544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jan 27 16:41:25 2021","interfaces":[{"interface":"back","average":{"1min":1.9550000000000001,"5min":1.8260000000000001,"15min":1.5089999999999999},"min":{"1min":1.2170000000000001,"5min":0.87,"15min":0.87},"max":{"1min":3.258,"5min":8.8019999999999996,"15min":8.8019999999999996},"last":2.2480000000000002},{"interface":"front","average":{"1min":2.4489999999999998,"5min":2.1320000000000001,"15min":1.7210000000000001},"min":{"1min":1.2450000000000001,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.1689999999999996,"5min":8.1270000000000007,"15min":8.1270000000000007},"last":2.3439999999999999}]},{"osd":2,"last update":"Wed Jan 27 16:41:49 2021","interfaces":[{"interface":"back","average":{"1min":2.536,"5min":2.2989999999999999,"15min":2.073},"min":{"1min":1.839,"5min":1.321,"15min":1.321},"max":{"1min":3.3860000000000001,"5min":7.0010000000000003,"15min":7.0010000000000003},"last":3.1579999999999999},{"interface":"front","average":{"1min":2.2690000000000001,"5min":2.1840000000000002,"15min":1.954},"min":{"1min":1.6319999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"max":{"1min":4.0720000000000001,"5min":8.5860000000000003,"15min":8.5860000000000003},"last":2.4569999999999999}]},{"osd":3,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":2.7570000000000001,"5min":2.577,"15min":2.4020000000000001},"min":{"1min":1.8779999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":3.335,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":3.4169999999999998},{"interface":"front","average":{"1min":2.681,"5min":2.6200000000000001,"15min":2.4710000000000001},"min":{"1min":1.6180000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"max":{"1min":3.6680000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":2.7789999999999999}]},{"osd":4,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":2.7360000000000002,"15min":2.657},"min":{"1min":2.419,"5min":1.7549999999999999,"15min":1.7549999999999999},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":3.2269999999999999},{"interface":"front","average":{"1min":3.0169999999999999,"5min":2.895,"15min":2.7000000000000002},"min":{"1min":2.4729999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.887,"5min":10.484999999999999,"15min":10.484999999999999},"last":3.8130000000000002}]},{"osd":5,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.1509999999999998,"5min":3.1440000000000001,"15min":3.1019999999999999},"min":{"1min":1.9770000000000001,"5min":1.881,"15min":1.881},"max":{"1min":4.0279999999999996,"5min":5.3040000000000003,"15min":5.3040000000000003},"last":4.1369999999999996},{"interface":"front","average":{"1min":3.391,"5min":3.3079999999999998,"15min":3.105},"min":{"1min":2.1949999999999998,"5min":1.6659999999999999,"15min":1.6659999999999999},"max":{"1min":3.9039999999999999,"5min":12.02,"15min":12.02},"last":4.2640000000000002}]},{"osd":6,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":3.681,"5min":3.4769999999999999,"15min":3.5009999999999999},"min":{"1min":2.8799999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"max":{"1min":5.399,"5min":6.5529999999999999,"15min":6.5529999999999999},"last":3.6539999999999999},{"interface":"front","average":{"1min":3.798,"5min":3.6989999999999998,"15min":3.762},"min":{"1min":2.851,"5min":2.0110000000000001,"15min":2.0110000000000001},"max":{"1min":5.0590000000000002,"5min":7.8280000000000003,"15min":7.8280000000000003},"last":3.9300000000000002}]},{"osd":7,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.6970000000000001,"5min":3.9060000000000001,"15min":4.04},"min":{"1min":2.4529999999999998,"5min":2.113,"15min":2.113},"max":{"1min":4.3300000000000001,"5min":12.147,"15min":12.147},"last":4.6849999999999996},{"interface":"front","average":{"1min":3.8399999999999999,"5min":3.827,"15min":3.8109999999999999},"min":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"max":{"1min":4.5490000000000004,"5min":8.3239999999999998,"15min":8.3239999999999998},"last":4.3739999999999997}]}]},{"osd":2,"up_from":21,"seq":90194313288,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":811008,"data_stored":286033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.944,"15min":1.7270000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":2.782},{"interface":"front","average":{"1min":2.0289999999999999,"5min":2.0129999999999999,"15min":1.758},"min":{"1min":1.2549999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"max":{"1min":3.7530000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":2.0830000000000002}]},{"osd":1,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.3500000000000001,"5min":2.1539999999999999,"15min":1.8320000000000001},"min":{"1min":1.0760000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":5.1050000000000004,"5min":5.1050000000000004,"15min":5.1050000000000004},"last":1.98},{"interface":"front","average":{"1min":2.1560000000000001,"5min":2.262,"15min":2.02},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":2.3639999999999999}]},{"osd":3,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":2.629,"5min":2.6829999999999998,"15min":2.407},"min":{"1min":1.956,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":3.2400000000000002,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":2.4449999999999998},{"interface":"front","average":{"1min":2.7759999999999998,"5min":2.7309999999999999,"15min":2.544},"min":{"1min":1.581,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":3.488,"5min":4.7679999999999998,"15min":4.7679999999999998},"last":3.2799999999999998}]},{"osd":4,"last update":"Wed Jan 27 16:41:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3839999999999999,"5min":2.3279999999999998,"15min":2.2429999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":3.266,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":3.0830000000000002},{"interface":"front","average":{"1min":3.0369999999999999,"5min":3.0139999999999998,"15min":2.8460000000000001},"min":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.5720000000000001,"5min":4.5720000000000001,"15min":4.5720000000000001},"last":3}]},{"osd":5,"last update":"Wed Jan 27 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":3.109,"15min":3.077},"min":{"1min":2.0920000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"max":{"1min":3.956,"5min":5.1559999999999997,"15min":5.1559999999999997},"last":3.677},{"interface":"front","average":{"1min":2.726,"5min":2.7450000000000001,"15min":2.6989999999999998},"min":{"1min":1.823,"5min":1.2470000000000001,"15min":1.2470000000000001},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.0419999999999998},"last":3.54}]},{"osd":6,"last update":"Wed Jan 27 16:41:43 2021","interfaces":[{"interface":"back","average":{"1min":2.9409999999999998,"5min":3.032,"15min":3.0089999999999999},"min":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"max":{"1min":4.1200000000000001,"5min":4.1529999999999996,"15min":4.1529999999999996},"last":2.6589999999999998},{"interface":"front","average":{"1min":3.3149999999999999,"5min":3.5840000000000001,"15min":3.665},"min":{"1min":1.756,"5min":1.756,"15min":1.756},"max":{"1min":5.3810000000000002,"5min":5.3810000000000002,"15min":5.3810000000000002},"last":4.0910000000000002}]},{"osd":7,"last update":"Wed Jan 27 16:42:12 2021","interfaces":[{"interface":"back","average":{"1min":3.3919999999999999,"5min":3.5529999999999999,"15min":3.6110000000000002},"min":{"1min":2.4940000000000002,"5min":1.607,"15min":1.607},"max":{"1min":3.9660000000000002,"5min":5.4020000000000001,"15min":5.4020000000000001},"last":3.2330000000000001},{"interface":"front","average":{"1min":3.4889999999999999,"5min":3.7010000000000001,"15min":3.77},"min":{"1min":2.532,"5min":2.1019999999999999,"15min":2.1019999999999999},"max":{"1min":4.4039999999999999,"5min":5.5469999999999997,"15min":5.5469999999999997},"last":3.887}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6504,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738648,"statfs":{"total":95995035648,"available":95988375552,"internally_reserved":0,"allocated":950272,"data_stored":290818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":1.9279999999999999,"15min":1.6519999999999999},"min":{"1min":1.498,"5min":1.012,"15min":1.012},"max":{"1min":2.8410000000000002,"5min":8.875,"15min":8.875},"last":1.194},{"interface":"front","average":{"1min":2.4409999999999998,"5min":2.3559999999999999,"15min":2.1150000000000002},"min":{"1min":1.7889999999999999,"5min":1.401,"15min":1.401},"max":{"1min":3.4260000000000002,"5min":8.9890000000000008,"15min":8.9890000000000008},"last":1.589}]},{"osd":1,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":2.036,"15min":1.923},"min":{"1min":1.716,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":1.405},{"interface":"front","average":{"1min":2.206,"5min":2.1640000000000001,"15min":2.1040000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":4.117,"5min":4.117,"15min":4.117},"last":2.1669999999999998}]},{"osd":2,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.3490000000000002,"15min":2.1930000000000001},"min":{"1min":1.796,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.4340000000000002,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":2.5099999999999998},{"interface":"front","average":{"1min":2.6850000000000001,"5min":2.5760000000000001,"15min":2.5089999999999999},"min":{"1min":1.827,"5min":1.452,"15min":1.452},"max":{"1min":4.9109999999999996,"5min":5.1459999999999999,"15min":5.1459999999999999},"last":1.665}]},{"osd":4,"last update":"Wed Jan 27 16:41:44 2021","interfaces":[{"interface":"back","average":{"1min":2.9510000000000001,"5min":2.6989999999999998,"15min":2.4990000000000001},"min":{"1min":1.528,"5min":1.528,"15min":1.528},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":2.3999999999999999},{"interface":"front","average":{"1min":2.9329999999999998,"5min":2.7389999999999999,"15min":2.6429999999999998},"min":{"1min":1.625,"5min":1.625,"15min":1.625},"max":{"1min":4.0090000000000003,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":2.4689999999999999}]},{"osd":5,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":3.1179999999999999,"5min":3.016,"15min":2.964},"min":{"1min":2.2250000000000001,"5min":1.617,"15min":1.617},"max":{"1min":4.2309999999999999,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":2.887},{"interface":"front","average":{"1min":3.419,"5min":3.1989999999999998,"15min":3.077},"min":{"1min":2.649,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":4.1150000000000002,"5min":4.4690000000000003,"15min":4.4690000000000003},"last":2.7440000000000002}]},{"osd":6,"last update":"Wed Jan 27 16:41:44 2021","interfaces":[{"interface":"back","average":{"1min":3.1970000000000001,"5min":3.2509999999999999,"15min":3.27},"min":{"1min":1.776,"5min":1.776,"15min":1.776},"max":{"1min":3.9039999999999999,"5min":4.1449999999999996,"15min":4.1449999999999996},"last":2.6520000000000001},{"interface":"front","average":{"1min":3.4289999999999998,"5min":3.359,"15min":3.363},"min":{"1min":2.4100000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":5.4160000000000004,"5min":5.4160000000000004,"15min":5.4160000000000004},"last":3.2829999999999999}]},{"osd":7,"last update":"Wed Jan 27 16:42:16 2021","interfaces":[{"interface":"back","average":{"1min":3.6589999999999998,"5min":3.5699999999999998,"15min":3.5579999999999998},"min":{"1min":2.1709999999999998,"5min":2.097,"15min":2.097},"max":{"1min":4.5049999999999999,"5min":4.8550000000000004,"15min":4.8550000000000004},"last":3.133},{"interface":"front","average":{"1min":3.7050000000000001,"5min":3.6000000000000001,"15min":3.5800000000000001},"min":{"1min":2.5299999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"max":{"1min":5.8280000000000003,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":2.8079999999999998}]}]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6460,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5568,"kb_avail":93738692,"statfs":{"total":95995035648,"available":95988420608,"internally_reserved":0,"allocated":905216,"data_stored":289731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5701632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.0430000000000001,"15min":2.0329999999999999},"min":{"1min":1.6080000000000001,"5min":1.044,"15min":1.044},"max":{"1min":2.9399999999999999,"5min":5.9130000000000003,"15min":5.9130000000000003},"last":2.9550000000000001},{"interface":"front","average":{"1min":2.2480000000000002,"5min":2.048,"15min":2.0179999999999998},"min":{"1min":1.4159999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"max":{"1min":3.6019999999999999,"5min":6.8300000000000001,"15min":6.8300000000000001},"last":1.5289999999999999}]},{"osd":1,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.198,"15min":2.1040000000000001},"min":{"1min":1.369,"5min":1.302,"15min":1.302},"max":{"1min":3.109,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":1.6919999999999999},{"interface":"front","average":{"1min":2.5310000000000001,"5min":2.3610000000000002,"15min":2.3420000000000001},"min":{"1min":1.8440000000000001,"5min":1.202,"15min":1.202},"max":{"1min":3.7770000000000001,"5min":7.0449999999999999,"15min":7.0449999999999999},"last":2.774}]},{"osd":2,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":2.5110000000000001,"15min":2.456},"min":{"1min":2.052,"5min":1.3979999999999999,"15min":1.3979999999999999},"max":{"1min":3.4079999999999999,"5min":7.2030000000000003,"15min":7.2030000000000003},"last":2.222},{"interface":"front","average":{"1min":2.4169999999999998,"5min":2.2850000000000001,"15min":2.2200000000000002},"min":{"1min":1.885,"5min":1.466,"15min":1.466},"max":{"1min":3.3889999999999998,"5min":4.7140000000000004,"15min":4.7140000000000004},"last":2.1070000000000002}]},{"osd":3,"last update":"Wed Jan 27 16:41:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5790000000000002,"5min":2.3700000000000001,"15min":2.306},"min":{"1min":1.748,"5min":1.397,"15min":1.397},"max":{"1min":3.383,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":1.609},{"interface":"front","average":{"1min":3.1030000000000002,"5min":2.8149999999999999,"15min":2.6840000000000002},"min":{"1min":2.4550000000000001,"5min":1.385,"15min":1.385},"max":{"1min":3.6299999999999999,"5min":6.3170000000000002,"15min":6.3170000000000002},"last":3.1560000000000001}]},{"osd":5,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.157,"5min":2.9180000000000001,"15min":2.7080000000000002},"min":{"1min":2.4359999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"max":{"1min":4.0129999999999999,"5min":7.6950000000000003,"15min":7.6950000000000003},"last":3.5880000000000001},{"interface":"front","average":{"1min":2.9889999999999999,"5min":2.706,"15min":2.5880000000000001},"min":{"1min":1.9490000000000001,"5min":1.173,"15min":1.173},"max":{"1min":3.6949999999999998,"5min":5.2009999999999996,"15min":5.2009999999999996},"last":2.6720000000000002}]},{"osd":6,"last update":"Wed Jan 27 16:41:49 2021","interfaces":[{"interface":"back","average":{"1min":3.4630000000000001,"5min":2.996,"15min":2.8380000000000001},"min":{"1min":2.496,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":4.5709999999999997,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":3.3679999999999999},{"interface":"front","average":{"1min":3.5840000000000001,"5min":3.0779999999999998,"15min":2.9359999999999999},"min":{"1min":2.9169999999999998,"5min":1.444,"15min":1.444},"max":{"1min":4.2229999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":3.2120000000000002}]},{"osd":7,"last update":"Wed Jan 27 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":3.371,"5min":3.177,"15min":3.1099999999999999},"min":{"1min":2.7679999999999998,"5min":1.405,"15min":1.405},"max":{"1min":3.9750000000000001,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":3.29},{"interface":"front","average":{"1min":3.5649999999999999,"5min":3.4350000000000001,"15min":3.383},"min":{"1min":3.0449999999999999,"5min":1.548,"15min":1.548},"max":{"1min":4.3680000000000003,"5min":5.7190000000000003,"15min":5.7190000000000003},"last":3.6760000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6248,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738904,"statfs":{"total":95995035648,"available":95988637696,"internally_reserved":0,"allocated":819200,"data_stored":285893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":1.9159999999999999,"15min":1.77},"min":{"1min":1.502,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":2.306,"5min":2.0800000000000001,"15min":1.996},"min":{"1min":1.552,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":3.8969999999999998,"5min":3.8969999999999998,"15min":3.8969999999999998},"last":2.6259999999999999}]},{"osd":1,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.173,"15min":2.2189999999999999},"min":{"1min":1.3169999999999999,"5min":0.872,"15min":0.872},"max":{"1min":2.9620000000000002,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":2.1309999999999998},{"interface":"front","average":{"1min":2.7869999999999999,"5min":2.4670000000000001,"15min":2.3540000000000001},"min":{"1min":1.8280000000000001,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.835,"5min":4.5179999999999998,"15min":4.5179999999999998},"last":2.306}]},{"osd":2,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":2.4169999999999998,"15min":2.2650000000000001},"min":{"1min":1.629,"5min":1.099,"15min":1.099},"max":{"1min":5.4550000000000001,"5min":5.4550000000000001,"15min":5.4550000000000001},"last":1.95},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.589,"15min":2.5800000000000001},"min":{"1min":1.6160000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":3.762,"5min":5.2469999999999999,"15min":5.2469999999999999},"last":2.508}]},{"osd":3,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.1389999999999998,"5min":2.7200000000000002,"15min":2.5329999999999999},"min":{"1min":2.395,"5min":1.3129999999999999,"15min":1.3129999999999999},"max":{"1min":4.6050000000000004,"5min":4.9509999999999996,"15min":4.9509999999999996},"last":2.7090000000000001},{"interface":"front","average":{"1min":2.887,"5min":2.7829999999999999,"15min":2.7229999999999999},"min":{"1min":1.8129999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":4.2569999999999997,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":3.2789999999999999}]},{"osd":4,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.2639999999999998,"5min":2.8730000000000002,"15min":2.661},"min":{"1min":1.8240000000000001,"5min":1.161,"15min":1.161},"max":{"1min":4.4530000000000003,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":3.113},{"interface":"front","average":{"1min":3.3660000000000001,"5min":2.8929999999999998,"15min":2.7120000000000002},"min":{"1min":2.4769999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":4.4749999999999996,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":2.9969999999999999}]},{"osd":6,"last update":"Wed Jan 27 16:41:45 2021","interfaces":[{"interface":"back","average":{"1min":3.4159999999999999,"5min":3.1150000000000002,"15min":2.9849999999999999},"min":{"1min":2.6829999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":4.7089999999999996,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":2.9119999999999999},{"interface":"front","average":{"1min":3.8410000000000002,"5min":3.3119999999999998,"15min":3.161},"min":{"1min":2.6549999999999998,"5min":1.4159999999999999,"15min":1.4159999999999999},"max":{"1min":5.8170000000000002,"5min":6.633,"15min":6.633},"last":3.3700000000000001}]},{"osd":7,"last update":"Wed Jan 27 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":3.7759999999999998,"5min":3.5019999999999998,"15min":3.3820000000000001},"min":{"1min":3.0209999999999999,"5min":1.506,"15min":1.506},"max":{"1min":4.9050000000000002,"5min":5.7839999999999998,"15min":5.7839999999999998},"last":3.448},{"interface":"front","average":{"1min":3.9359999999999999,"5min":3.6890000000000001,"15min":3.6160000000000001},"min":{"1min":2.9289999999999998,"5min":1.55,"15min":1.55},"max":{"1min":5.2000000000000002,"5min":5.3399999999999999,"15min":5.3399999999999999},"last":3.617}]}]}]}} 2021-01-27T16:42:27.095 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-01-27T16:42:27.096 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-27T16:42:27.097 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-01-27T16:42:27.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo cephadm --image quay.ceph.io/ceph-ci/ceph:9f8421bb8d39043f85c071a52714801b60d36be5 shell --fsid 294bdd66-60bd-11eb-8f9a-001a4aab830c -- ceph health --format=json 2021-01-27T16:42:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/294bdd66-60bd-11eb-8f9a-001a4aab830c/mon.a/config 2021-01-27T16:42:28.290 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:28 smithi106 bash[9795]: cluster 2021-01-27T16:42:27.470056+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:28.290 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:28 smithi106 bash[13484]: cluster 2021-01-27T16:42:27.470056+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:28.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:28 smithi094 bash[9811]: cluster 2021-01-27T16:42:27.470056+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:29.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:29 smithi106 bash[9795]: cluster 2021-01-27T16:42:29.471053+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:29.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:29 smithi106 bash[13484]: cluster 2021-01-27T16:42:29.471053+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:29 smithi094 bash[9811]: cluster 2021-01-27T16:42:29.471053+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:30.587 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-01-27T16:42:30.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:30 smithi106 bash[9795]: audit 2021-01-27T16:42:30.586920+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.106:0/1634361403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:42:30.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:30 smithi106 bash[13484]: audit 2021-01-27T16:42:30.586920+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.106:0/1634361403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:42:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:30 smithi094 bash[9811]: audit 2021-01-27T16:42:30.586920+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.106:0/1634361403' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-27T16:42:31.457 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-27T16:42:31.458 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-01-27T16:42:31.458 INFO:tasks.cephadm:Setup complete, yielding 2021-01-27T16:42:31.459 INFO:teuthology.run_tasks:Running task workunit... 2021-01-27T16:42:31.475 INFO:tasks.workunit:Pulling workunits from ref 9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:42:31.477 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-27T16:42:31.477 DEBUG:teuthology.orchestra.run.smithi106:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-27T16:42:31.485 INFO:teuthology.orchestra.run.smithi106.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-27T16:42:31.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-27T16:42:31.486 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-01-27T16:42:31.533 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-01-27T16:42:31.534 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-01-27T16:42:31.539 INFO:tasks.workunit:timeout=3h 2021-01-27T16:42:31.540 INFO:tasks.workunit:cleanup=True 2021-01-27T16:42:31.540 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 9f8421bb8d39043f85c071a52714801b60d36be5 2021-01-27T16:42:31.549 INFO:tasks.workunit.client.0.smithi106.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-27T16:42:31.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:31 smithi106 bash[9795]: cluster 2021-01-27T16:42:31.472179+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:31.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:31 smithi106 bash[13484]: cluster 2021-01-27T16:42:31.472179+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:31.955 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:31 smithi106 bash[10032]: debug 2021-01-27T16:42:31.683+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:32.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:31 smithi094 bash[9811]: cluster 2021-01-27T16:42:31.472179+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:33.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:33 smithi094 bash[9811]: audit 2021-01-27T16:42:31.686626+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:33.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:33 smithi106 bash[9795]: audit 2021-01-27T16:42:31.686626+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:33.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:33 smithi106 bash[13484]: audit 2021-01-27T16:42:31.686626+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:34.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:34 smithi094 bash[9811]: cluster 2021-01-27T16:42:33.473244+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:34.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:34 smithi106 bash[9795]: cluster 2021-01-27T16:42:33.473244+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:34.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:34 smithi106 bash[13484]: cluster 2021-01-27T16:42:33.473244+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:35.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:35 smithi106 bash[9795]: cluster 2021-01-27T16:42:35.474378+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:35.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:35 smithi106 bash[13484]: cluster 2021-01-27T16:42:35.474378+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:36.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:35 smithi094 bash[9811]: cluster 2021-01-27T16:42:35.474378+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:38.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:38 smithi094 bash[9811]: cluster 2021-01-27T16:42:37.475593+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:38.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:38 smithi106 bash[9795]: cluster 2021-01-27T16:42:37.475593+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:38.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:38 smithi106 bash[13484]: cluster 2021-01-27T16:42:37.475593+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:39.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:39 smithi094 bash[9811]: cluster 2021-01-27T16:42:39.476635+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:39.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:39 smithi106 bash[9795]: cluster 2021-01-27T16:42:39.476635+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:39.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:39 smithi106 bash[13484]: cluster 2021-01-27T16:42:39.476635+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:41.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:41 smithi106 bash[9795]: cluster 2021-01-27T16:42:41.477740+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:41.955 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:41 smithi106 bash[10032]: debug 2021-01-27T16:42:41.694+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:41.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:41 smithi106 bash[13484]: cluster 2021-01-27T16:42:41.477740+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:42.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:41 smithi094 bash[9811]: cluster 2021-01-27T16:42:41.477740+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:42.037 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:43.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:43 smithi094 bash[9811]: audit 2021-01-27T16:42:41.697814+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:43.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:43 smithi106 bash[13484]: audit 2021-01-27T16:42:41.697814+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:43 smithi106 bash[9795]: audit 2021-01-27T16:42:41.697814+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:44.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:44 smithi094 bash[9811]: cluster 2021-01-27T16:42:43.478758+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:44.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:44 smithi106 bash[13484]: cluster 2021-01-27T16:42:43.478758+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:44.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:44 smithi106 bash[9795]: cluster 2021-01-27T16:42:43.478758+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:45.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:45 smithi106 bash[9795]: cluster 2021-01-27T16:42:45.479802+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:45.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:45 smithi106 bash[13484]: cluster 2021-01-27T16:42:45.479802+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:46.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:45 smithi094 bash[9811]: cluster 2021-01-27T16:42:45.479802+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:48.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:48 smithi094 bash[9811]: cluster 2021-01-27T16:42:47.480968+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:48.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:48 smithi106 bash[9795]: cluster 2021-01-27T16:42:47.480968+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:48.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:48 smithi106 bash[13484]: cluster 2021-01-27T16:42:47.480968+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:49.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:49 smithi106 bash[9795]: cluster 2021-01-27T16:42:49.482023+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:49.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:49 smithi106 bash[13484]: cluster 2021-01-27T16:42:49.482023+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:50.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:49 smithi094 bash[9811]: cluster 2021-01-27T16:42:49.482023+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:51.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:42:51 smithi106 bash[10032]: debug 2021-01-27T16:42:51.706+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:42:51.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:51 smithi106 bash[9795]: cluster 2021-01-27T16:42:51.483123+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:51.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:51 smithi106 bash[13484]: cluster 2021-01-27T16:42:51.483123+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:52.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:51 smithi094 bash[9811]: cluster 2021-01-27T16:42:51.483123+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:52.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:42:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:42:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:53 smithi094 bash[9811]: audit 2021-01-27T16:42:51.709002+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:53.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:53 smithi106 bash[9795]: audit 2021-01-27T16:42:51.709002+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:53.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:53 smithi106 bash[13484]: audit 2021-01-27T16:42:51.709002+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:42:54.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:54 smithi106 bash[9795]: cluster 2021-01-27T16:42:53.484228+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:54.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:54 smithi106 bash[13484]: cluster 2021-01-27T16:42:53.484228+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:54.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:54 smithi094 bash[9811]: cluster 2021-01-27T16:42:53.484228+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:55.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:55 smithi106 bash[9795]: cluster 2021-01-27T16:42:55.485291+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:55.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:55 smithi106 bash[13484]: cluster 2021-01-27T16:42:55.485291+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:56.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:55 smithi094 bash[9811]: cluster 2021-01-27T16:42:55.485291+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:42:58.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:58 smithi094 bash[9811]: cluster 2021-01-27T16:42:57.486420+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:58.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:58 smithi106 bash[9795]: cluster 2021-01-27T16:42:57.486420+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:58.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:58 smithi106 bash[13484]: cluster 2021-01-27T16:42:57.486420+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:59.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:42:59 smithi106 bash[9795]: cluster 2021-01-27T16:42:59.487496+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:42:59.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:42:59 smithi106 bash[13484]: cluster 2021-01-27T16:42:59.487496+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:00.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:42:59 smithi094 bash[9811]: cluster 2021-01-27T16:42:59.487496+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:01.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:01 smithi106 bash[9795]: cluster 2021-01-27T16:43:01.488637+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:01.955 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:01 smithi106 bash[10032]: debug 2021-01-27T16:43:01.718+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:01.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:01 smithi106 bash[13484]: cluster 2021-01-27T16:43:01.488637+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:02.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:02.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:01 smithi094 bash[9811]: cluster 2021-01-27T16:43:01.488637+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:03.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:03 smithi094 bash[9811]: audit 2021-01-27T16:43:01.720222+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:03.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:03 smithi106 bash[9795]: audit 2021-01-27T16:43:01.720222+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:03.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:03 smithi106 bash[13484]: audit 2021-01-27T16:43:01.720222+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:04.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:04 smithi106 bash[9795]: cluster 2021-01-27T16:43:03.489706+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:04.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:04 smithi106 bash[13484]: cluster 2021-01-27T16:43:03.489706+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:04.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:04 smithi094 bash[9811]: cluster 2021-01-27T16:43:03.489706+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:05.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:05 smithi106 bash[9795]: cluster 2021-01-27T16:43:05.490748+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:05.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:05 smithi106 bash[13484]: cluster 2021-01-27T16:43:05.490748+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:06.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:05 smithi094 bash[9811]: cluster 2021-01-27T16:43:05.490748+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:08.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:08 smithi094 bash[9811]: cluster 2021-01-27T16:43:07.492015+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:08.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:08 smithi106 bash[9795]: cluster 2021-01-27T16:43:07.492015+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:08.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:08 smithi106 bash[13484]: cluster 2021-01-27T16:43:07.492015+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:09.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:09 smithi106 bash[9795]: cluster 2021-01-27T16:43:09.493077+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:09.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:09 smithi106 bash[13484]: cluster 2021-01-27T16:43:09.493077+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:10.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:09 smithi094 bash[9811]: cluster 2021-01-27T16:43:09.493077+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:11.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:11 smithi106 bash[10032]: debug 2021-01-27T16:43:11.730+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:11.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:11 smithi106 bash[13484]: cluster 2021-01-27T16:43:11.494131+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:11.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:11 smithi106 bash[9795]: cluster 2021-01-27T16:43:11.494131+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:12.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:12.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:11 smithi094 bash[9811]: cluster 2021-01-27T16:43:11.494131+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:13.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:13 smithi094 bash[9811]: audit 2021-01-27T16:43:11.731412+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:13.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:13 smithi106 bash[9795]: audit 2021-01-27T16:43:11.731412+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:13.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:13 smithi106 bash[13484]: audit 2021-01-27T16:43:11.731412+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:14 smithi094 bash[9811]: cluster 2021-01-27T16:43:13.494744+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:14.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:14 smithi106 bash[9795]: cluster 2021-01-27T16:43:13.494744+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:14.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:14 smithi106 bash[13484]: cluster 2021-01-27T16:43:13.494744+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:15.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:15 smithi106 bash[9795]: cluster 2021-01-27T16:43:15.495658+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:15 smithi106 bash[13484]: cluster 2021-01-27T16:43:15.495658+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:16.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:15 smithi094 bash[9811]: cluster 2021-01-27T16:43:15.495658+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:18.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:18 smithi106 bash[9795]: cluster 2021-01-27T16:43:17.496339+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:18.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:18 smithi106 bash[13484]: cluster 2021-01-27T16:43:17.496339+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:18.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:18 smithi094 bash[9811]: cluster 2021-01-27T16:43:17.496339+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:19.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:19 smithi106 bash[9795]: cluster 2021-01-27T16:43:19.496927+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:19.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:19 smithi106 bash[13484]: cluster 2021-01-27T16:43:19.496927+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:20.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:19 smithi094 bash[9811]: cluster 2021-01-27T16:43:19.496927+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:21.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:21 smithi106 bash[10032]: debug 2021-01-27T16:43:21.737+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:21.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:21 smithi106 bash[9795]: cluster 2021-01-27T16:43:21.497965+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:21.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:21 smithi106 bash[13484]: cluster 2021-01-27T16:43:21.497965+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:22.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:21 smithi094 bash[9811]: cluster 2021-01-27T16:43:21.497965+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:22.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:23 smithi094 bash[9811]: audit 2021-01-27T16:43:21.739697+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:23.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:23 smithi106 bash[13484]: audit 2021-01-27T16:43:21.739697+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:23.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:23 smithi106 bash[9795]: audit 2021-01-27T16:43:21.739697+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:24.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:24 smithi106 bash[9795]: cluster 2021-01-27T16:43:23.499029+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:24.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:24 smithi106 bash[13484]: cluster 2021-01-27T16:43:23.499029+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:24 smithi094 bash[9811]: cluster 2021-01-27T16:43:23.499029+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:25.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:25 smithi106 bash[13484]: cluster 2021-01-27T16:43:25.499807+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:25.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:25 smithi106 bash[9795]: cluster 2021-01-27T16:43:25.499807+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:26.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:25 smithi094 bash[9811]: cluster 2021-01-27T16:43:25.499807+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:26.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:26 smithi106 bash[13484]: audit 2021-01-27T16:43:25.754886+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:43:26.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:26 smithi106 bash[13484]: audit 2021-01-27T16:43:25.756813+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:43:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:26 smithi106 bash[9795]: audit 2021-01-27T16:43:25.754886+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:43:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:26 smithi106 bash[9795]: audit 2021-01-27T16:43:25.756813+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:43:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:26 smithi094 bash[9811]: audit 2021-01-27T16:43:25.754886+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:43:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:26 smithi094 bash[9811]: audit 2021-01-27T16:43:25.756813+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:43:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:28 smithi094 bash[9811]: cluster 2021-01-27T16:43:27.500825+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:28.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:28 smithi106 bash[9795]: cluster 2021-01-27T16:43:27.500825+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:28.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:28 smithi106 bash[13484]: cluster 2021-01-27T16:43:27.500825+0000 mgr.y (mgr.14138) 490 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:29.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:29 smithi106 bash[9795]: cluster 2021-01-27T16:43:29.501915+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:29.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:29 smithi106 bash[13484]: cluster 2021-01-27T16:43:29.501915+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:29 smithi094 bash[9811]: cluster 2021-01-27T16:43:29.501915+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:31.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:31 smithi106 bash[9795]: cluster 2021-01-27T16:43:31.503066+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:31.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:31 smithi106 bash[10032]: debug 2021-01-27T16:43:31.745+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:31.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:31 smithi106 bash[13484]: cluster 2021-01-27T16:43:31.503066+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:32.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:32.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:31 smithi094 bash[9811]: cluster 2021-01-27T16:43:31.503066+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:33.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:33 smithi106 bash[13484]: audit 2021-01-27T16:43:31.750858+0000 mgr.y (mgr.14138) 493 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:33.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:33 smithi106 bash[9795]: audit 2021-01-27T16:43:31.750858+0000 mgr.y (mgr.14138) 493 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:33.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:33 smithi094 bash[9811]: audit 2021-01-27T16:43:31.750858+0000 mgr.y (mgr.14138) 493 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:34.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:34 smithi106 bash[13484]: cluster 2021-01-27T16:43:33.504155+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:34.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:34 smithi106 bash[9795]: cluster 2021-01-27T16:43:33.504155+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:34.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:34 smithi094 bash[9811]: cluster 2021-01-27T16:43:33.504155+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-27T16:43:35.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:35 smithi106 bash[9795]: cluster 2021-01-27T16:43:35.505083+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:35.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:35 smithi106 bash[13484]: cluster 2021-01-27T16:43:35.505083+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:36.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:35 smithi094 bash[9811]: cluster 2021-01-27T16:43:35.505083+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:37.891 INFO:tasks.workunit.client.0.smithi106.stderr:Note: switching to '9f8421bb8d39043f85c071a52714801b60d36be5'. 2021-01-27T16:43:37.891 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.892 INFO:tasks.workunit.client.0.smithi106.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-27T16:43:37.892 INFO:tasks.workunit.client.0.smithi106.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-27T16:43:37.892 INFO:tasks.workunit.client.0.smithi106.stderr:state without impacting any branches by switching back to a branch. 2021-01-27T16:43:37.892 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.892 INFO:tasks.workunit.client.0.smithi106.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-27T16:43:37.893 INFO:tasks.workunit.client.0.smithi106.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-27T16:43:37.893 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.893 INFO:tasks.workunit.client.0.smithi106.stderr: git switch -c 2021-01-27T16:43:37.893 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.894 INFO:tasks.workunit.client.0.smithi106.stderr:Or undo this operation with: 2021-01-27T16:43:37.894 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.894 INFO:tasks.workunit.client.0.smithi106.stderr: git switch - 2021-01-27T16:43:37.894 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.895 INFO:tasks.workunit.client.0.smithi106.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-27T16:43:37.895 INFO:tasks.workunit.client.0.smithi106.stderr: 2021-01-27T16:43:37.895 INFO:tasks.workunit.client.0.smithi106.stderr:HEAD is now at 9f8421bb8d Merge branch 'cephadm-simplify-test-python' of https://github.com/liewegas/ceph into wip-sage-testing-2021-01-26-2148 2021-01-27T16:43:37.896 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-27T16:43:37.969 INFO:tasks.workunit.client.0.smithi106.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-27T16:43:37.972 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T16:43:37.972 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-27T16:43:38.822 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-27T16:43:38.908 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-27T16:43:38.965 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-27T16:43:38.967 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T16:43:38.968 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-27T16:43:39.026 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-27T16:43:39.030 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-01-27T16:43:39.030 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-27T16:43:39.036 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2021-01-27T16:43:39.038 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2021-01-27T16:43:39.038 DEBUG:teuthology.orchestra.run.smithi106:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f8421bb8d39043f85c071a52714801b60d36be5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-27T16:43:39.048 INFO:tasks.workunit.client.0.smithi106.stderr:+ ceph osd pool create rbd 2021-01-27T16:43:39.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:39 smithi106 bash[9795]: cluster 2021-01-27T16:43:37.506109+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:39.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:39 smithi106 bash[13484]: cluster 2021-01-27T16:43:37.506109+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:39.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:39 smithi094 bash[9811]: cluster 2021-01-27T16:43:37.506109+0000 mgr.y (mgr.14138) 496 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:40.152 INFO:tasks.workunit.client.0.smithi106.stderr:pool 'rbd' already exists 2021-01-27T16:43:40.160 INFO:tasks.workunit.client.0.smithi106.stderr:+ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-27T16:43:40.161 INFO:tasks.workunit.client.0.smithi106.stderr:+ python3 -m nose -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py 2021-01-27T16:43:40.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:40 smithi106 bash[9795]: audit 2021-01-27T16:43:39.317548+0000 mon.a (mon.0) 656 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:40.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:40 smithi106 bash[13484]: audit 2021-01-27T16:43:39.317548+0000 mon.a (mon.0) 656 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:40.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:40 smithi094 bash[9811]: audit 2021-01-27T16:43:39.317548+0000 mon.a (mon.0) 656 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:41.103 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestCommand.test_ceph_osd_pool_create_utf8 ... ok 2021-01-27T16:43:41.139 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestCommand.test_monmap_dump ... ok 2021-01-27T16:43:41.154 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestCommand.test_osd_bench ... ok 2021-01-27T16:43:41.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[9795]: cluster 2021-01-27T16:43:39.507068+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:41.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[9795]: audit 2021-01-27T16:43:40.062027+0000 mon.a (mon.0) 657 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T16:43:41.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[9795]: cluster 2021-01-27T16:43:40.062149+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T16:43:41.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[9795]: audit 2021-01-27T16:43:40.148311+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:41.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[13484]: cluster 2021-01-27T16:43:39.507068+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:41.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[13484]: audit 2021-01-27T16:43:40.062027+0000 mon.a (mon.0) 657 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T16:43:41.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[13484]: cluster 2021-01-27T16:43:40.062149+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T16:43:41.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[13484]: audit 2021-01-27T16:43:40.148311+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:41 smithi094 bash[9811]: cluster 2021-01-27T16:43:39.507068+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-27T16:43:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:41 smithi094 bash[9811]: audit 2021-01-27T16:43:40.062027+0000 mon.a (mon.0) 657 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-27T16:43:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:41 smithi094 bash[9811]: cluster 2021-01-27T16:43:40.062149+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-27T16:43:41.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:41 smithi094 bash[9811]: audit 2021-01-27T16:43:40.148311+0000 mon.a (mon.0) 659 : audit [INF] from='client.? 172.21.15.106:0/4170499231' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-27T16:43:42.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:42.130 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:41 smithi106 bash[10032]: debug 2021-01-27T16:43:41.757+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:40.645262+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.106:0/1899818859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:40.645877+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:41.097438+0000 mon.a (mon.0) 661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T16:43:42.132 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: cluster 2021-01-27T16:43:41.097685+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T16:43:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:41.135600+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T16:43:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:41.136980+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:43:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: audit 2021-01-27T16:43:41.137364+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T16:43:42.133 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[9795]: cluster 2021-01-27T16:43:42.100174+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T16:43:42.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:40.645262+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.106:0/1899818859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:40.645877+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:41.097438+0000 mon.a (mon.0) 661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T16:43:42.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: cluster 2021-01-27T16:43:41.097685+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T16:43:42.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:41.135600+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T16:43:42.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:41.136980+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:43:42.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: audit 2021-01-27T16:43:41.137364+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T16:43:42.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:42 smithi106 bash[13484]: cluster 2021-01-27T16:43:42.100174+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T16:43:42.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:40.645262+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.106:0/1899818859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:40.645877+0000 mon.a (mon.0) 660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-27T16:43:42.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:41.097438+0000 mon.a (mon.0) 661 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-27T16:43:42.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: cluster 2021-01-27T16:43:41.097685+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-27T16:43:42.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:41.135600+0000 mon.a (mon.0) 663 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-27T16:43:42.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:41.136980+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-27T16:43:42.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: audit 2021-01-27T16:43:41.137364+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.15.106:0/746914448' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-27T16:43:42.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:42 smithi094 bash[9811]: cluster 2021-01-27T16:43:42.100174+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-27T16:43:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[9795]: cluster 2021-01-27T16:43:41.508171+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v361: 180 pgs: 8 creating+peering, 35 unknown, 137 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T16:43:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[9795]: audit 2021-01-27T16:43:41.762268+0000 mgr.y (mgr.14138) 499 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:43.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[9795]: cluster 2021-01-27T16:43:43.103307+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T16:43:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[13484]: cluster 2021-01-27T16:43:41.508171+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v361: 180 pgs: 8 creating+peering, 35 unknown, 137 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T16:43:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[13484]: audit 2021-01-27T16:43:41.762268+0000 mgr.y (mgr.14138) 499 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:43 smithi106 bash[13484]: cluster 2021-01-27T16:43:43.103307+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T16:43:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:43 smithi094 bash[9811]: cluster 2021-01-27T16:43:41.508171+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v361: 180 pgs: 8 creating+peering, 35 unknown, 137 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2021-01-27T16:43:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:43 smithi094 bash[9811]: audit 2021-01-27T16:43:41.762268+0000 mgr.y (mgr.14138) 499 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:43 smithi094 bash[9811]: cluster 2021-01-27T16:43:43.103307+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-27T16:43:45.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:45 smithi106 bash[9795]: cluster 2021-01-27T16:43:43.509087+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 212 pgs: 22 creating+peering, 25 unknown, 165 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:45.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:45 smithi106 bash[9795]: cluster 2021-01-27T16:43:44.106169+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T16:43:45.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:45 smithi106 bash[13484]: cluster 2021-01-27T16:43:43.509087+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 212 pgs: 22 creating+peering, 25 unknown, 165 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:45.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:45 smithi106 bash[13484]: cluster 2021-01-27T16:43:44.106169+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T16:43:45.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:45 smithi094 bash[9811]: cluster 2021-01-27T16:43:43.509087+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v364: 212 pgs: 22 creating+peering, 25 unknown, 165 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:45.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:45 smithi094 bash[9811]: cluster 2021-01-27T16:43:44.106169+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-27T16:43:46.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:46 smithi106 bash[9795]: cluster 2021-01-27T16:43:45.108369+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T16:43:46.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:46 smithi106 bash[13484]: cluster 2021-01-27T16:43:45.108369+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T16:43:46.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:46 smithi094 bash[9811]: cluster 2021-01-27T16:43:45.108369+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-27T16:43:47.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:47 smithi106 bash[9795]: cluster 2021-01-27T16:43:45.510244+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 212 pgs: 17 creating+peering, 7 unknown, 188 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:47.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:47 smithi106 bash[9795]: cluster 2021-01-27T16:43:46.130238+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T16:43:47.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:47 smithi106 bash[13484]: cluster 2021-01-27T16:43:45.510244+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 212 pgs: 17 creating+peering, 7 unknown, 188 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:47.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:47 smithi106 bash[13484]: cluster 2021-01-27T16:43:46.130238+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T16:43:47.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:47 smithi094 bash[9811]: cluster 2021-01-27T16:43:45.510244+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v367: 212 pgs: 17 creating+peering, 7 unknown, 188 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:47.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:47 smithi094 bash[9811]: cluster 2021-01-27T16:43:46.130238+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-27T16:43:48.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[9795]: cluster 2021-01-27T16:43:47.136880+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T16:43:48.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[9795]: audit 2021-01-27T16:43:47.141027+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.106:0/1978531775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[9795]: audit 2021-01-27T16:43:47.143074+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[9795]: audit 2021-01-27T16:43:48.140006+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:48.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[9795]: cluster 2021-01-27T16:43:48.140268+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T16:43:48.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[13484]: cluster 2021-01-27T16:43:47.136880+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T16:43:48.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[13484]: audit 2021-01-27T16:43:47.141027+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.106:0/1978531775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[13484]: audit 2021-01-27T16:43:47.143074+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[13484]: audit 2021-01-27T16:43:48.140006+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:48.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:48 smithi106 bash[13484]: cluster 2021-01-27T16:43:48.140268+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T16:43:48.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:48 smithi094 bash[9811]: cluster 2021-01-27T16:43:47.136880+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-27T16:43:48.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:48 smithi094 bash[9811]: audit 2021-01-27T16:43:47.141027+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.106:0/1978531775' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:48 smithi094 bash[9811]: audit 2021-01-27T16:43:47.143074+0000 mon.a (mon.0) 672 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:48.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:48 smithi094 bash[9811]: audit 2021-01-27T16:43:48.140006+0000 mon.a (mon.0) 673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:48.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:48 smithi094 bash[9811]: cluster 2021-01-27T16:43:48.140268+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-27T16:43:49.144 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoCtxSelfManagedSnaps.test ... ok 2021-01-27T16:43:49.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:49 smithi106 bash[9795]: cluster 2021-01-27T16:43:47.511448+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v370: 212 pgs: 7 creating+peering, 205 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:49.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:49 smithi106 bash[9795]: cluster 2021-01-27T16:43:49.139578+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T16:43:49.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:49 smithi106 bash[13484]: cluster 2021-01-27T16:43:47.511448+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v370: 212 pgs: 7 creating+peering, 205 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:49.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:49 smithi106 bash[13484]: cluster 2021-01-27T16:43:49.139578+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T16:43:49.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:49 smithi094 bash[9811]: cluster 2021-01-27T16:43:47.511448+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v370: 212 pgs: 7 creating+peering, 205 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:49.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:49 smithi094 bash[9811]: cluster 2021-01-27T16:43:49.139578+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-27T16:43:51.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:51 smithi106 bash[9795]: cluster 2021-01-27T16:43:49.512258+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v373: 180 pgs: 180 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:43:51.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:51 smithi106 bash[9795]: cluster 2021-01-27T16:43:50.172266+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T16:43:51.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:51 smithi106 bash[13484]: cluster 2021-01-27T16:43:49.512258+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v373: 180 pgs: 180 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:43:51.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:51 smithi106 bash[13484]: cluster 2021-01-27T16:43:50.172266+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T16:43:51.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:51 smithi094 bash[9811]: cluster 2021-01-27T16:43:49.512258+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v373: 180 pgs: 180 active+clean; 25 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:43:51.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:51 smithi094 bash[9811]: cluster 2021-01-27T16:43:50.172266+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-27T16:43:52.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:43:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:43:52.193 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:43:51 smithi106 bash[10032]: debug 2021-01-27T16:43:51.761+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:43:52.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:52 smithi106 bash[9795]: cluster 2021-01-27T16:43:51.173959+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T16:43:52.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:52 smithi106 bash[9795]: audit 2021-01-27T16:43:51.230794+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:52.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:52 smithi106 bash[13484]: cluster 2021-01-27T16:43:51.173959+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T16:43:52.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:52 smithi106 bash[13484]: audit 2021-01-27T16:43:51.230794+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:52.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:52 smithi094 bash[9811]: cluster 2021-01-27T16:43:51.173959+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-27T16:43:52.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:52 smithi094 bash[9811]: audit 2021-01-27T16:43:51.230794+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:53.195 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_append ... ok 2021-01-27T16:43:53.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[9795]: cluster 2021-01-27T16:43:51.513210+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 212 pgs: 3 creating+peering, 27 unknown, 182 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:53.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[9795]: audit 2021-01-27T16:43:51.764350+0000 mgr.y (mgr.14138) 505 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:53.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[9795]: audit 2021-01-27T16:43:52.188165+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:53.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[9795]: cluster 2021-01-27T16:43:52.188345+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T16:43:53.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[9795]: cluster 2021-01-27T16:43:53.191146+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T16:43:53.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[13484]: cluster 2021-01-27T16:43:51.513210+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 212 pgs: 3 creating+peering, 27 unknown, 182 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:53.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[13484]: audit 2021-01-27T16:43:51.764350+0000 mgr.y (mgr.14138) 505 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:53.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[13484]: audit 2021-01-27T16:43:52.188165+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:53.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[13484]: cluster 2021-01-27T16:43:52.188345+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T16:43:53.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:53 smithi106 bash[13484]: cluster 2021-01-27T16:43:53.191146+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T16:43:53.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:53 smithi094 bash[9811]: cluster 2021-01-27T16:43:51.513210+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 212 pgs: 3 creating+peering, 27 unknown, 182 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:53.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:53 smithi094 bash[9811]: audit 2021-01-27T16:43:51.764350+0000 mgr.y (mgr.14138) 505 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:43:53.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:53 smithi094 bash[9811]: audit 2021-01-27T16:43:52.188165+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.106:0/2778595894' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:53.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:53 smithi094 bash[9811]: cluster 2021-01-27T16:43:52.188345+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-27T16:43:53.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:53 smithi094 bash[9811]: cluster 2021-01-27T16:43:53.191146+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-27T16:43:55.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:55 smithi094 bash[9811]: cluster 2021-01-27T16:43:53.514152+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v379: 180 pgs: 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:55.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:55 smithi094 bash[9811]: cluster 2021-01-27T16:43:54.216998+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T16:43:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:55 smithi106 bash[9795]: cluster 2021-01-27T16:43:53.514152+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v379: 180 pgs: 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:55 smithi106 bash[9795]: cluster 2021-01-27T16:43:54.216998+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T16:43:55.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:55 smithi106 bash[13484]: cluster 2021-01-27T16:43:53.514152+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v379: 180 pgs: 180 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:55.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:55 smithi106 bash[13484]: cluster 2021-01-27T16:43:54.216998+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-27T16:43:56.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:56 smithi094 bash[9811]: cluster 2021-01-27T16:43:55.221012+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T16:43:56.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:56 smithi094 bash[9811]: audit 2021-01-27T16:43:55.251617+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.106:0/3866383219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:56.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:56 smithi094 bash[9811]: audit 2021-01-27T16:43:55.252022+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:56.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[9795]: cluster 2021-01-27T16:43:55.221012+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T16:43:56.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[9795]: audit 2021-01-27T16:43:55.251617+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.106:0/3866383219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:56.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[9795]: audit 2021-01-27T16:43:55.252022+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:56.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[13484]: cluster 2021-01-27T16:43:55.221012+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-27T16:43:56.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[13484]: audit 2021-01-27T16:43:55.251617+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.106:0/3866383219' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:56.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:56 smithi106 bash[13484]: audit 2021-01-27T16:43:55.252022+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:43:57.254 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_cmpext ... ok 2021-01-27T16:43:57.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:57 smithi094 bash[9811]: cluster 2021-01-27T16:43:55.515129+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v382: 212 pgs: 8 creating+peering, 20 unknown, 184 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:57.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:57 smithi094 bash[9811]: audit 2021-01-27T16:43:56.242507+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:57.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:57 smithi094 bash[9811]: cluster 2021-01-27T16:43:56.242673+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T16:43:57.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[9795]: cluster 2021-01-27T16:43:55.515129+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v382: 212 pgs: 8 creating+peering, 20 unknown, 184 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:57.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[9795]: audit 2021-01-27T16:43:56.242507+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:57.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[9795]: cluster 2021-01-27T16:43:56.242673+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T16:43:57.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[13484]: cluster 2021-01-27T16:43:55.515129+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v382: 212 pgs: 8 creating+peering, 20 unknown, 184 active+clean; 25 KiB data, 58 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:57.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[13484]: audit 2021-01-27T16:43:56.242507+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:43:57.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:57 smithi106 bash[13484]: cluster 2021-01-27T16:43:56.242673+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-27T16:43:58.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:58 smithi094 bash[9811]: cluster 2021-01-27T16:43:57.252307+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T16:43:58.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:58 smithi106 bash[9795]: cluster 2021-01-27T16:43:57.252307+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T16:43:58.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:58 smithi106 bash[13484]: cluster 2021-01-27T16:43:57.252307+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-27T16:43:59.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:59 smithi094 bash[9811]: cluster 2021-01-27T16:43:57.515980+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v385: 180 pgs: 180 active+clean; 25 KiB data, 59 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:59.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:43:59 smithi094 bash[9811]: cluster 2021-01-27T16:43:58.262031+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T16:43:59.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:59 smithi106 bash[9795]: cluster 2021-01-27T16:43:57.515980+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v385: 180 pgs: 180 active+clean; 25 KiB data, 59 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:59.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:43:59 smithi106 bash[9795]: cluster 2021-01-27T16:43:58.262031+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T16:43:59.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:59 smithi106 bash[13484]: cluster 2021-01-27T16:43:57.515980+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v385: 180 pgs: 180 active+clean; 25 KiB data, 59 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:43:59.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:43:59 smithi106 bash[13484]: cluster 2021-01-27T16:43:58.262031+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-27T16:44:00.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:00 smithi094 bash[9811]: cluster 2021-01-27T16:43:59.273620+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T16:44:00.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:00 smithi094 bash[9811]: audit 2021-01-27T16:43:59.337652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.106:0/1960973111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:00.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:00 smithi094 bash[9811]: audit 2021-01-27T16:43:59.338159+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:00.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[9795]: cluster 2021-01-27T16:43:59.273620+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T16:44:00.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[9795]: audit 2021-01-27T16:43:59.337652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.106:0/1960973111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:00.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[9795]: audit 2021-01-27T16:43:59.338159+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:00.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[13484]: cluster 2021-01-27T16:43:59.273620+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-27T16:44:00.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[13484]: audit 2021-01-27T16:43:59.337652+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.106:0/1960973111' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:00.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:00 smithi106 bash[13484]: audit 2021-01-27T16:43:59.338159+0000 mon.a (mon.0) 690 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:01.301 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_execute ... ok 2021-01-27T16:44:01.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:01 smithi094 bash[9811]: cluster 2021-01-27T16:43:59.516991+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v388: 212 pgs: 5 creating+peering, 25 unknown, 182 active+clean; 25 KiB data, 60 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:01.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:01 smithi094 bash[9811]: audit 2021-01-27T16:44:00.285486+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:01.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:01 smithi094 bash[9811]: cluster 2021-01-27T16:44:00.285621+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T16:44:01.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[9795]: cluster 2021-01-27T16:43:59.516991+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v388: 212 pgs: 5 creating+peering, 25 unknown, 182 active+clean; 25 KiB data, 60 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:01.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[9795]: audit 2021-01-27T16:44:00.285486+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:01.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[9795]: cluster 2021-01-27T16:44:00.285621+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T16:44:01.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[13484]: cluster 2021-01-27T16:43:59.516991+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v388: 212 pgs: 5 creating+peering, 25 unknown, 182 active+clean; 25 KiB data, 60 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:01.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[13484]: audit 2021-01-27T16:44:00.285486+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:01.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[13484]: cluster 2021-01-27T16:44:00.285621+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-27T16:44:02.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:02.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:01 smithi106 bash[10032]: debug 2021-01-27T16:44:01.764+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:02.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:02 smithi106 bash[9795]: cluster 2021-01-27T16:44:01.296160+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T16:44:02.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:02 smithi106 bash[13484]: cluster 2021-01-27T16:44:01.296160+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T16:44:02.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:02 smithi094 bash[9811]: cluster 2021-01-27T16:44:01.296160+0000 mon.a (mon.0) 693 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-27T16:44:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[9795]: cluster 2021-01-27T16:44:01.517941+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v391: 180 pgs: 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[9795]: audit 2021-01-27T16:44:01.769086+0000 mgr.y (mgr.14138) 511 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:03.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[9795]: cluster 2021-01-27T16:44:02.307323+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T16:44:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[13484]: cluster 2021-01-27T16:44:01.517941+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v391: 180 pgs: 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[13484]: audit 2021-01-27T16:44:01.769086+0000 mgr.y (mgr.14138) 511 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:03.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:03 smithi106 bash[13484]: cluster 2021-01-27T16:44:02.307323+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T16:44:03.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:03 smithi094 bash[9811]: cluster 2021-01-27T16:44:01.517941+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v391: 180 pgs: 180 active+clean; 25 KiB data, 64 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:03.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:03 smithi094 bash[9811]: audit 2021-01-27T16:44:01.769086+0000 mgr.y (mgr.14138) 511 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:03.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:03 smithi094 bash[9811]: cluster 2021-01-27T16:44:02.307323+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-27T16:44:04.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[13484]: cluster 2021-01-27T16:44:03.320113+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T16:44:04.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[13484]: audit 2021-01-27T16:44:03.353993+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:04.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[13484]: audit 2021-01-27T16:44:03.354476+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:04.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[13484]: audit 2021-01-27T16:44:03.354777+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:04.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[9795]: cluster 2021-01-27T16:44:03.320113+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T16:44:04.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[9795]: audit 2021-01-27T16:44:03.353993+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:04.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[9795]: audit 2021-01-27T16:44:03.354476+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:04.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[9795]: audit 2021-01-27T16:44:03.354777+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:04.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:04 smithi106 bash[9795]: debug 2021-01-27T16:44:04.328+0000 7fb35b430700 -1 mon.a@0(leader).osd e86 definitely_dead 0 2021-01-27T16:44:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:04 smithi094 bash[9811]: cluster 2021-01-27T16:44:03.320113+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-27T16:44:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:04 smithi094 bash[9811]: audit 2021-01-27T16:44:03.353993+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:04 smithi094 bash[9811]: audit 2021-01-27T16:44:03.354476+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:04.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:04 smithi094 bash[9811]: audit 2021-01-27T16:44:03.354777+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:05.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: cluster 2021-01-27T16:44:03.518995+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v394: 212 pgs: 11 creating+peering, 15 unknown, 186 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:05.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: cluster 2021-01-27T16:44:04.314290+0000 mon.a (mon.0) 697 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:05.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: cluster 2021-01-27T16:44:04.315776+0000 mon.a (mon.0) 698 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:05.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: audit 2021-01-27T16:44:04.330115+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:05.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: cluster 2021-01-27T16:44:04.330198+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T16:44:05.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: audit 2021-01-27T16:44:04.331749+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:05.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[9795]: audit 2021-01-27T16:44:04.332227+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:05.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: cluster 2021-01-27T16:44:03.518995+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v394: 212 pgs: 11 creating+peering, 15 unknown, 186 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:05.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: cluster 2021-01-27T16:44:04.314290+0000 mon.a (mon.0) 697 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:05.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: cluster 2021-01-27T16:44:04.315776+0000 mon.a (mon.0) 698 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:05.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: audit 2021-01-27T16:44:04.330115+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:05.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: cluster 2021-01-27T16:44:04.330198+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T16:44:05.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: audit 2021-01-27T16:44:04.331749+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:05.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:05 smithi106 bash[13484]: audit 2021-01-27T16:44:04.332227+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: cluster 2021-01-27T16:44:03.518995+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v394: 212 pgs: 11 creating+peering, 15 unknown, 186 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: cluster 2021-01-27T16:44:04.314290+0000 mon.a (mon.0) 697 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: cluster 2021-01-27T16:44:04.315776+0000 mon.a (mon.0) 698 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: audit 2021-01-27T16:44:04.330115+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: cluster 2021-01-27T16:44:04.330198+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-27T16:44:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: audit 2021-01-27T16:44:04.331749+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:05.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:05 smithi094 bash[9811]: audit 2021-01-27T16:44:04.332227+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-27T16:44:06.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[9795]: cluster 2021-01-27T16:44:05.326622+0000 mon.a (mon.0) 702 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:06.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[9795]: audit 2021-01-27T16:44:05.337384+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T16:44:06.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[9795]: cluster 2021-01-27T16:44:05.337907+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e87: 8 total, 5 up, 8 in 2021-01-27T16:44:06.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[9795]: cluster 2021-01-27T16:44:06.338311+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T16:44:06.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[13484]: cluster 2021-01-27T16:44:05.326622+0000 mon.a (mon.0) 702 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:06.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[13484]: audit 2021-01-27T16:44:05.337384+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T16:44:06.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[13484]: cluster 2021-01-27T16:44:05.337907+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e87: 8 total, 5 up, 8 in 2021-01-27T16:44:06.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:06 smithi106 bash[13484]: cluster 2021-01-27T16:44:06.338311+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T16:44:06.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:06 smithi094 bash[9811]: cluster 2021-01-27T16:44:05.326622+0000 mon.a (mon.0) 702 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:06.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:06 smithi094 bash[9811]: audit 2021-01-27T16:44:05.337384+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-27T16:44:06.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:06 smithi094 bash[9811]: cluster 2021-01-27T16:44:05.337907+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e87: 8 total, 5 up, 8 in 2021-01-27T16:44:06.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:06 smithi094 bash[9811]: cluster 2021-01-27T16:44:06.338311+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-27T16:44:07.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[9811]: cluster 2021-01-27T16:44:05.520089+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v397: 212 pgs: 59 stale+active+clean, 11 creating+peering, 5 unknown, 137 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:07.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[9811]: cluster 2021-01-27T16:44:06.830551+0000 mon.a (mon.0) 706 : cluster [INF] osd.5 marked itself dead as of e88 2021-01-27T16:44:07.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[9811]: cluster 2021-01-27T16:44:06.831355+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T16:44:07.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[9811]: cluster 2021-01-27T16:44:06.831368+0000 osd.5 (osd.5) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:07.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[9811]: cluster 2021-01-27T16:44:07.357823+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-27T16:44:07.537 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[15110]: debug 2021-01-27T16:44:07.276+0000 7f1fdc162700 -1 osd.5 88 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:07.537 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:44:07 smithi094 bash[15110]: debug 2021-01-27T16:44:07.372+0000 7f1fcc6b7700 -1 osd.5 89 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:07.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[9795]: cluster 2021-01-27T16:44:05.520089+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v397: 212 pgs: 59 stale+active+clean, 11 creating+peering, 5 unknown, 137 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:07.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[9795]: cluster 2021-01-27T16:44:06.830551+0000 mon.a (mon.0) 706 : cluster [INF] osd.5 marked itself dead as of e88 2021-01-27T16:44:07.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[9795]: cluster 2021-01-27T16:44:06.831355+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T16:44:07.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[9795]: cluster 2021-01-27T16:44:06.831368+0000 osd.5 (osd.5) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:07.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[9795]: cluster 2021-01-27T16:44:07.357823+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-27T16:44:07.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[13484]: cluster 2021-01-27T16:44:05.520089+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v397: 212 pgs: 59 stale+active+clean, 11 creating+peering, 5 unknown, 137 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:07.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[13484]: cluster 2021-01-27T16:44:06.830551+0000 mon.a (mon.0) 706 : cluster [INF] osd.5 marked itself dead as of e88 2021-01-27T16:44:07.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[13484]: cluster 2021-01-27T16:44:06.831355+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-27T16:44:07.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[13484]: cluster 2021-01-27T16:44:06.831368+0000 osd.5 (osd.5) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:07.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:07 smithi106 bash[13484]: cluster 2021-01-27T16:44:07.357823+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-27T16:44:08.536 INFO:journalctl@ceph.osd.4.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[12635]: debug 2021-01-27T16:44:08.156+0000 7fc02ea2a700 -1 osd.4 89 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[9811]: cluster 2021-01-27T16:44:07.358979+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[9811]: cluster 2021-01-27T16:44:07.358987+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[9811]: cluster 2021-01-27T16:44:07.381107+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T16:44:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[9811]: audit 2021-01-27T16:44:08.347822+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:08.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:08 smithi094 bash[9811]: audit 2021-01-27T16:44:08.348396+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:08.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[9795]: cluster 2021-01-27T16:44:07.358979+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:08.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[9795]: cluster 2021-01-27T16:44:07.358987+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:08.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[9795]: cluster 2021-01-27T16:44:07.381107+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T16:44:08.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[9795]: audit 2021-01-27T16:44:08.347822+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:08.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[9795]: audit 2021-01-27T16:44:08.348396+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:08.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[13484]: cluster 2021-01-27T16:44:07.358979+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:08.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[13484]: cluster 2021-01-27T16:44:07.358987+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e87 2021-01-27T16:44:08.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[13484]: cluster 2021-01-27T16:44:07.381107+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-27T16:44:08.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[13484]: audit 2021-01-27T16:44:08.347822+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:08.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:08 smithi106 bash[13484]: audit 2021-01-27T16:44:08.348396+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:09.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:07.521206+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v400: 212 pgs: 106 active+clean, 6 creating+peering, 33 stale+active+clean, 4 undersized+degraded+peered+wait, 15 active+undersized+degraded+wait, 31 active+undersized+wait, 17 undersized+peered+wait; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 157/978 objects degraded (16.053%) 2021-01-27T16:44:09.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:08.369143+0000 mon.a (mon.0) 710 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:09.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:08.369785+0000 mon.a (mon.0) 711 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive (PG_AVAILABILITY) 2021-01-27T16:44:09.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:08.369822+0000 mon.a (mon.0) 712 : cluster [WRN] Health check failed: Degraded data redundancy: 157/978 objects degraded (16.053%), 19 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:09.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: audit 2021-01-27T16:44:08.381583+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:09.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:08.381658+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T16:44:09.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.385337+0000 mon.a (mon.0) 715 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:44:09.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.385420+0000 mon.a (mon.0) 716 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:09.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.385466+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-01-27T16:44:09.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[9795]: audit 2021-01-27T16:44:09.388537+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:09.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:07.521206+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v400: 212 pgs: 106 active+clean, 6 creating+peering, 33 stale+active+clean, 4 undersized+degraded+peered+wait, 15 active+undersized+degraded+wait, 31 active+undersized+wait, 17 undersized+peered+wait; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 157/978 objects degraded (16.053%) 2021-01-27T16:44:09.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:08.369143+0000 mon.a (mon.0) 710 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:09.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:08.369785+0000 mon.a (mon.0) 711 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive (PG_AVAILABILITY) 2021-01-27T16:44:09.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:08.369822+0000 mon.a (mon.0) 712 : cluster [WRN] Health check failed: Degraded data redundancy: 157/978 objects degraded (16.053%), 19 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:09.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: audit 2021-01-27T16:44:08.381583+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:09.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:08.381658+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T16:44:09.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.385337+0000 mon.a (mon.0) 715 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:44:09.708 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.385420+0000 mon.a (mon.0) 716 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:09.709 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.385466+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-01-27T16:44:09.709 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:09 smithi106 bash[13484]: audit 2021-01-27T16:44:09.388537+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:09.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:07.521206+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v400: 212 pgs: 106 active+clean, 6 creating+peering, 33 stale+active+clean, 4 undersized+degraded+peered+wait, 15 active+undersized+degraded+wait, 31 active+undersized+wait, 17 undersized+peered+wait; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail; 157/978 objects degraded (16.053%) 2021-01-27T16:44:09.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:08.369143+0000 mon.a (mon.0) 710 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:09.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:08.369785+0000 mon.a (mon.0) 711 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive (PG_AVAILABILITY) 2021-01-27T16:44:09.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:08.369822+0000 mon.a (mon.0) 712 : cluster [WRN] Health check failed: Degraded data redundancy: 157/978 objects degraded (16.053%), 19 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:09.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: audit 2021-01-27T16:44:08.381583+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:09.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:08.381658+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-27T16:44:09.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.385337+0000 mon.a (mon.0) 715 : cluster [INF] osd.5 [v2:172.21.15.94:6808/624844330,v1:172.21.15.94:6809/624844330] boot 2021-01-27T16:44:09.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.385420+0000 mon.a (mon.0) 716 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:09.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.385466+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 7 up, 8 in 2021-01-27T16:44:09.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:09 smithi094 bash[9811]: audit 2021-01-27T16:44:09.388537+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:10.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: audit 2021-01-27T16:44:09.390936+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:44:10.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.525571+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T16:44:10.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.525577+0000 osd.3 (osd.3) 4 : cluster [DBG] map e91 wrongly marked me down at e87 2021-01-27T16:44:10.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.526783+0000 mon.a (mon.0) 720 : cluster [INF] osd.3 marked itself dead as of e91 2021-01-27T16:44:10.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:10.377826+0000 mon.a (mon.0) 721 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-01-27T16:44:10.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:10.394680+0000 mon.a (mon.0) 722 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:44:10.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: cluster 2021-01-27T16:44:10.395236+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T16:44:10.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[13484]: audit 2021-01-27T16:44:10.396577+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:44:10.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: audit 2021-01-27T16:44:09.390936+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:44:10.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.525571+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T16:44:10.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.525577+0000 osd.3 (osd.3) 4 : cluster [DBG] map e91 wrongly marked me down at e87 2021-01-27T16:44:10.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.526783+0000 mon.a (mon.0) 720 : cluster [INF] osd.3 marked itself dead as of e91 2021-01-27T16:44:10.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:10.377826+0000 mon.a (mon.0) 721 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-01-27T16:44:10.707 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:10.394680+0000 mon.a (mon.0) 722 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:44:10.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: cluster 2021-01-27T16:44:10.395236+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T16:44:10.708 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:10 smithi106 bash[9795]: audit 2021-01-27T16:44:10.396577+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:44:10.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: audit 2021-01-27T16:44:09.390936+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-27T16:44:10.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.525571+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-27T16:44:10.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.525577+0000 osd.3 (osd.3) 4 : cluster [DBG] map e91 wrongly marked me down at e87 2021-01-27T16:44:10.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.526783+0000 mon.a (mon.0) 720 : cluster [INF] osd.3 marked itself dead as of e91 2021-01-27T16:44:10.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:10.377826+0000 mon.a (mon.0) 721 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-01-27T16:44:10.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:10.394680+0000 mon.a (mon.0) 722 : cluster [INF] osd.3 [v2:172.21.15.106:6826/2657826375,v1:172.21.15.106:6827/2657826375] boot 2021-01-27T16:44:10.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: cluster 2021-01-27T16:44:10.395236+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-27T16:44:10.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:10 smithi094 bash[9811]: audit 2021-01-27T16:44:10.396577+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-27T16:44:11.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:11 smithi106 bash[13484]: cluster 2021-01-27T16:44:09.522396+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v403: 212 pgs: 15 peering, 2 undersized+peered, 12 active+undersized, 57 active+clean, 34 stale+active+clean, 6 undersized+degraded+peered+wait, 22 active+undersized+degraded+wait, 2 active+undersized+degraded, 1 undersized+degraded+peered, 41 active+undersized+wait, 20 undersized+peered+wait; 25 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 233/978 objects degraded (23.824%) 2021-01-27T16:44:11.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:11 smithi106 bash[13484]: cluster 2021-01-27T16:44:11.394999+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T16:44:11.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:11 smithi106 bash[9795]: cluster 2021-01-27T16:44:09.522396+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v403: 212 pgs: 15 peering, 2 undersized+peered, 12 active+undersized, 57 active+clean, 34 stale+active+clean, 6 undersized+degraded+peered+wait, 22 active+undersized+degraded+wait, 2 active+undersized+degraded, 1 undersized+degraded+peered, 41 active+undersized+wait, 20 undersized+peered+wait; 25 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 233/978 objects degraded (23.824%) 2021-01-27T16:44:11.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:11 smithi106 bash[9795]: cluster 2021-01-27T16:44:11.394999+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T16:44:11.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:11 smithi094 bash[9811]: cluster 2021-01-27T16:44:09.522396+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v403: 212 pgs: 15 peering, 2 undersized+peered, 12 active+undersized, 57 active+clean, 34 stale+active+clean, 6 undersized+degraded+peered+wait, 22 active+undersized+degraded+wait, 2 active+undersized+degraded, 1 undersized+degraded+peered, 41 active+undersized+wait, 20 undersized+peered+wait; 25 KiB data, 92 MiB used, 715 GiB / 715 GiB avail; 233/978 objects degraded (23.824%) 2021-01-27T16:44:11.781 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:11 smithi094 bash[9811]: cluster 2021-01-27T16:44:11.394999+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-27T16:44:12.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:12.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:11 smithi106 bash[10032]: debug 2021-01-27T16:44:11.776+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:12.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:12 smithi106 bash[13484]: audit 2021-01-27T16:44:11.437565+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:12.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:12 smithi106 bash[13484]: audit 2021-01-27T16:44:11.438347+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:12.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:12 smithi106 bash[9795]: audit 2021-01-27T16:44:11.437565+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:12.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:12 smithi106 bash[9795]: audit 2021-01-27T16:44:11.438347+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:12.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:12 smithi094 bash[9811]: audit 2021-01-27T16:44:11.437565+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.106:0/3182718694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:12.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:12 smithi094 bash[9811]: audit 2021-01-27T16:44:11.438347+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:13.455 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete ... ok 2021-01-27T16:44:13.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:13 smithi094 bash[9811]: cluster 2021-01-27T16:44:11.523797+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v406: 212 pgs: 30 active+clean+wait, 42 peering, 1 undersized+peered, 11 active+undersized, 51 active+clean, 11 stale+active+clean, 4 undersized+degraded+peered+wait, 17 active+undersized+degraded+wait, 1 active+undersized+degraded, 1 undersized+degraded+peered, 31 active+undersized+wait, 12 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 168/978 objects degraded (17.178%) 2021-01-27T16:44:13.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:13 smithi094 bash[9811]: audit 2021-01-27T16:44:11.780271+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:13.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:13 smithi094 bash[9811]: audit 2021-01-27T16:44:12.433185+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:13.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:13 smithi094 bash[9811]: cluster 2021-01-27T16:44:12.433376+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T16:44:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[9795]: cluster 2021-01-27T16:44:11.523797+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v406: 212 pgs: 30 active+clean+wait, 42 peering, 1 undersized+peered, 11 active+undersized, 51 active+clean, 11 stale+active+clean, 4 undersized+degraded+peered+wait, 17 active+undersized+degraded+wait, 1 active+undersized+degraded, 1 undersized+degraded+peered, 31 active+undersized+wait, 12 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 168/978 objects degraded (17.178%) 2021-01-27T16:44:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[9795]: audit 2021-01-27T16:44:11.780271+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:13.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[9795]: audit 2021-01-27T16:44:12.433185+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:13.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[9795]: cluster 2021-01-27T16:44:12.433376+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T16:44:13.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[13484]: cluster 2021-01-27T16:44:11.523797+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v406: 212 pgs: 30 active+clean+wait, 42 peering, 1 undersized+peered, 11 active+undersized, 51 active+clean, 11 stale+active+clean, 4 undersized+degraded+peered+wait, 17 active+undersized+degraded+wait, 1 active+undersized+degraded, 1 undersized+degraded+peered, 31 active+undersized+wait, 12 undersized+peered+wait; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 168/978 objects degraded (17.178%) 2021-01-27T16:44:13.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[13484]: audit 2021-01-27T16:44:11.780271+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:13.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[13484]: audit 2021-01-27T16:44:12.433185+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:13.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:13 smithi106 bash[13484]: cluster 2021-01-27T16:44:12.433376+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-27T16:44:14.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:14 smithi094 bash[9811]: cluster 2021-01-27T16:44:13.450696+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T16:44:14.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:14 smithi106 bash[9795]: cluster 2021-01-27T16:44:13.450696+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T16:44:14.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:14 smithi106 bash[13484]: cluster 2021-01-27T16:44:13.450696+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-27T16:44:15.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:15 smithi094 bash[9811]: cluster 2021-01-27T16:44:13.524695+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v409: 180 pgs: 35 active+clean+wait, 34 peering, 105 active+clean, 2 active+undersized+degraded+wait, 4 active+undersized+wait; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 8/975 objects degraded (0.821%); 222 B/s, 2 objects/s recovering 2021-01-27T16:44:15.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:15 smithi094 bash[9811]: cluster 2021-01-27T16:44:14.456815+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:15.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:15 smithi094 bash[9811]: cluster 2021-01-27T16:44:14.456902+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive) 2021-01-27T16:44:15.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:15 smithi094 bash[9811]: cluster 2021-01-27T16:44:14.456970+0000 mon.a (mon.0) 732 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:15.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:15 smithi094 bash[9811]: cluster 2021-01-27T16:44:14.472229+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T16:44:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[13484]: cluster 2021-01-27T16:44:13.524695+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v409: 180 pgs: 35 active+clean+wait, 34 peering, 105 active+clean, 2 active+undersized+degraded+wait, 4 active+undersized+wait; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 8/975 objects degraded (0.821%); 222 B/s, 2 objects/s recovering 2021-01-27T16:44:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[13484]: cluster 2021-01-27T16:44:14.456815+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:15.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[13484]: cluster 2021-01-27T16:44:14.456902+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive) 2021-01-27T16:44:15.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[13484]: cluster 2021-01-27T16:44:14.456970+0000 mon.a (mon.0) 732 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:15.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[13484]: cluster 2021-01-27T16:44:14.472229+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T16:44:15.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[9795]: cluster 2021-01-27T16:44:13.524695+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v409: 180 pgs: 35 active+clean+wait, 34 peering, 105 active+clean, 2 active+undersized+degraded+wait, 4 active+undersized+wait; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 8/975 objects degraded (0.821%); 222 B/s, 2 objects/s recovering 2021-01-27T16:44:15.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[9795]: cluster 2021-01-27T16:44:14.456815+0000 mon.a (mon.0) 730 : cluster [WRN] Health check update: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:15.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[9795]: cluster 2021-01-27T16:44:14.456902+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive) 2021-01-27T16:44:15.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[9795]: cluster 2021-01-27T16:44:14.456970+0000 mon.a (mon.0) 732 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:15.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:15 smithi106 bash[9795]: cluster 2021-01-27T16:44:14.472229+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-27T16:44:16.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:16 smithi094 bash[9811]: cluster 2021-01-27T16:44:15.477744+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T16:44:16.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:16 smithi094 bash[9811]: audit 2021-01-27T16:44:15.514370+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:16.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:16 smithi094 bash[9811]: audit 2021-01-27T16:44:15.514988+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[13484]: cluster 2021-01-27T16:44:15.477744+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T16:44:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[13484]: audit 2021-01-27T16:44:15.514370+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[13484]: audit 2021-01-27T16:44:15.514988+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[9795]: cluster 2021-01-27T16:44:15.477744+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-27T16:44:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[9795]: audit 2021-01-27T16:44:15.514370+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-27T16:44:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[9795]: audit 2021-01-27T16:44:15.514988+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:16 smithi106 bash[9795]: debug 2021-01-27T16:44:16.484+0000 7fb35b430700 -1 mon.a@0(leader).osd e98 definitely_dead 0 2021-01-27T16:44:17.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: cluster 2021-01-27T16:44:15.525562+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v412: 212 pgs: 7 creating+peering, 22 unknown, 35 active+clean+wait, 148 active+clean; 25 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:17.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: cluster 2021-01-27T16:44:16.472461+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded) 2021-01-27T16:44:17.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: cluster 2021-01-27T16:44:16.472523+0000 mon.a (mon.0) 738 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:17.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: cluster 2021-01-27T16:44:16.473957+0000 mon.a (mon.0) 739 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:17.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: audit 2021-01-27T16:44:16.490045+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:17.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: cluster 2021-01-27T16:44:16.490136+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T16:44:17.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:17 smithi094 bash[9811]: audit 2021-01-27T16:44:16.490753+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T16:44:17.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: cluster 2021-01-27T16:44:15.525562+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v412: 212 pgs: 7 creating+peering, 22 unknown, 35 active+clean+wait, 148 active+clean; 25 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:17.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: cluster 2021-01-27T16:44:16.472461+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded) 2021-01-27T16:44:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: cluster 2021-01-27T16:44:16.472523+0000 mon.a (mon.0) 738 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: cluster 2021-01-27T16:44:16.473957+0000 mon.a (mon.0) 739 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: audit 2021-01-27T16:44:16.490045+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: cluster 2021-01-27T16:44:16.490136+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T16:44:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[9795]: audit 2021-01-27T16:44:16.490753+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T16:44:17.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: cluster 2021-01-27T16:44:15.525562+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v412: 212 pgs: 7 creating+peering, 22 unknown, 35 active+clean+wait, 148 active+clean; 25 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:17.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: cluster 2021-01-27T16:44:16.472461+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/975 objects degraded (0.821%), 2 pgs degraded) 2021-01-27T16:44:17.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: cluster 2021-01-27T16:44:16.472523+0000 mon.a (mon.0) 738 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:17.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: cluster 2021-01-27T16:44:16.473957+0000 mon.a (mon.0) 739 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:17.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: audit 2021-01-27T16:44:16.490045+0000 mon.a (mon.0) 740 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:17.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: cluster 2021-01-27T16:44:16.490136+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-27T16:44:17.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:17 smithi106 bash[13484]: audit 2021-01-27T16:44:16.490753+0000 mon.a (mon.0) 742 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-27T16:44:18.454 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[21560]: debug 2021-01-27T16:44:18.032+0000 7f68f8e9e700 -1 osd.2 99 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:18.455 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[19045]: debug 2021-01-27T16:44:18.240+0000 7f211de30700 -1 osd.1 99 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:18.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.483435+0000 mon.a (mon.0) 743 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:18.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: audit 2021-01-27T16:44:17.494439+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T16:44:18.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.494944+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T16:44:18.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.630482+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:18.788 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.630495+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.789 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.631826+0000 mon.a (mon.0) 746 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T16:44:18.789 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.901022+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T16:44:18.790 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.901034+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.790 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.901686+0000 mon.a (mon.0) 747 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-27T16:44:18.790 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:18.364952+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:18.791 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:18.364964+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.791 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:18.365573+0000 mon.a (mon.0) 748 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T16:44:18.792 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:18 smithi094 bash[9811]: cluster 2021-01-27T16:44:18.498221+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T16:44:18.954 INFO:journalctl@ceph.osd.1.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[19045]: debug 2021-01-27T16:44:18.492+0000 7f210eb86700 -1 osd.1 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:18.955 INFO:journalctl@ceph.osd.2.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[21560]: debug 2021-01-27T16:44:18.500+0000 7f68eb3f7700 -1 osd.2 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:18.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.483435+0000 mon.a (mon.0) 743 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:18.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: audit 2021-01-27T16:44:17.494439+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T16:44:18.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.494944+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T16:44:18.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.630482+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:18.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.630495+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.631826+0000 mon.a (mon.0) 746 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T16:44:18.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.901022+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T16:44:18.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.901034+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.901686+0000 mon.a (mon.0) 747 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-27T16:44:18.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:18.364952+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:18.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:18.364964+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:18.365573+0000 mon.a (mon.0) 748 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T16:44:18.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[13484]: cluster 2021-01-27T16:44:18.498221+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T16:44:18.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.483435+0000 mon.a (mon.0) 743 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:18.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: audit 2021-01-27T16:44:17.494439+0000 mon.a (mon.0) 744 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-27T16:44:18.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.494944+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-27T16:44:18.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.630482+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:18.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.630495+0000 osd.2 (osd.2) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.631826+0000 mon.a (mon.0) 746 : cluster [INF] osd.2 marked itself dead as of e99 2021-01-27T16:44:18.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.901022+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-27T16:44:18.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.901034+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.901686+0000 mon.a (mon.0) 747 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-27T16:44:18.960 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:18.364952+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:18.960 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:18.364964+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-27T16:44:18.960 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:18.365573+0000 mon.a (mon.0) 748 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-27T16:44:18.960 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:18 smithi106 bash[9795]: cluster 2021-01-27T16:44:18.498221+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-27T16:44:19.454 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:44:19 smithi106 bash[16567]: debug 2021-01-27T16:44:19.020+0000 7f81309f0700 -1 osd.0 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:19.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:19 smithi094 bash[9811]: cluster 2021-01-27T16:44:17.526120+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v415: 212 pgs: 7 stale+creating+peering, 66 stale+active+clean, 6 unknown, 35 active+clean+wait, 98 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:19.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:19 smithi094 bash[9811]: cluster 2021-01-27T16:44:18.499391+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:19.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:19 smithi106 bash[9795]: cluster 2021-01-27T16:44:17.526120+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v415: 212 pgs: 7 stale+creating+peering, 66 stale+active+clean, 6 unknown, 35 active+clean+wait, 98 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:19.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:19 smithi106 bash[9795]: cluster 2021-01-27T16:44:18.499391+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:19.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:19 smithi106 bash[13484]: cluster 2021-01-27T16:44:17.526120+0000 mgr.y (mgr.14138) 520 : cluster [DBG] pgmap v415: 212 pgs: 7 stale+creating+peering, 66 stale+active+clean, 6 unknown, 35 active+clean+wait, 98 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:19.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:19 smithi106 bash[13484]: cluster 2021-01-27T16:44:18.499391+0000 mon.a (mon.0) 750 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:20.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:20 smithi094 bash[9811]: cluster 2021-01-27T16:44:19.527639+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v417: 212 pgs: 9 undersized+peered, 2 undersized+degraded+peered, 29 peering, 4 stale+creating+peering, 49 stale+active+clean, 25 activating+undersized, 27 active+clean+wait, 67 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 252 B/s wr, 0 op/s; 92/978 objects degraded (9.407%) 2021-01-27T16:44:20.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:20 smithi094 bash[9811]: audit 2021-01-27T16:44:20.503377+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:20.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:20 smithi106 bash[9795]: cluster 2021-01-27T16:44:19.527639+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v417: 212 pgs: 9 undersized+peered, 2 undersized+degraded+peered, 29 peering, 4 stale+creating+peering, 49 stale+active+clean, 25 activating+undersized, 27 active+clean+wait, 67 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 252 B/s wr, 0 op/s; 92/978 objects degraded (9.407%) 2021-01-27T16:44:20.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:20 smithi106 bash[9795]: audit 2021-01-27T16:44:20.503377+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:20.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:20 smithi106 bash[13484]: cluster 2021-01-27T16:44:19.527639+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v417: 212 pgs: 9 undersized+peered, 2 undersized+degraded+peered, 29 peering, 4 stale+creating+peering, 49 stale+active+clean, 25 activating+undersized, 27 active+clean+wait, 67 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 252 B/s wr, 0 op/s; 92/978 objects degraded (9.407%) 2021-01-27T16:44:20.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:20 smithi106 bash[13484]: audit 2021-01-27T16:44:20.503377+0000 mon.a (mon.0) 751 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:21.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[10032]: debug 2021-01-27T16:44:21.784+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:21.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[9795]: cluster 2021-01-27T16:44:20.520568+0000 mon.a (mon.0) 752 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-01-27T16:44:21.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[9795]: cluster 2021-01-27T16:44:20.520626+0000 mon.a (mon.0) 753 : cluster [WRN] Health check failed: Degraded data redundancy: 92/978 objects degraded (9.407%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:21.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[9795]: cluster 2021-01-27T16:44:20.521880+0000 mon.a (mon.0) 754 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:21.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[9795]: audit 2021-01-27T16:44:20.538138+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:21.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[9795]: cluster 2021-01-27T16:44:20.538252+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T16:44:21.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[13484]: cluster 2021-01-27T16:44:20.520568+0000 mon.a (mon.0) 752 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-01-27T16:44:21.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[13484]: cluster 2021-01-27T16:44:20.520626+0000 mon.a (mon.0) 753 : cluster [WRN] Health check failed: Degraded data redundancy: 92/978 objects degraded (9.407%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:21.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[13484]: cluster 2021-01-27T16:44:20.521880+0000 mon.a (mon.0) 754 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:21.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[13484]: audit 2021-01-27T16:44:20.538138+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:21.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:21 smithi106 bash[13484]: cluster 2021-01-27T16:44:20.538252+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T16:44:22.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:22.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[9811]: cluster 2021-01-27T16:44:20.520568+0000 mon.a (mon.0) 752 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-01-27T16:44:22.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[9811]: cluster 2021-01-27T16:44:20.520626+0000 mon.a (mon.0) 753 : cluster [WRN] Health check failed: Degraded data redundancy: 92/978 objects degraded (9.407%), 2 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:22.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[9811]: cluster 2021-01-27T16:44:20.521880+0000 mon.a (mon.0) 754 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:22.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[9811]: audit 2021-01-27T16:44:20.538138+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:22.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:21 smithi094 bash[9811]: cluster 2021-01-27T16:44:20.538252+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-27T16:44:22.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.529132+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v419: 212 pgs: 39 active+undersized, 28 undersized+peered, 13 active+undersized+degraded, 8 undersized+degraded+peered, 29 peering, 1 stale+creating+peering, 17 stale+active+clean, 25 activating+undersized, 4 active+clean+wait, 48 active+clean; 25 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 203 B/s wr, 0 op/s; 251/978 objects degraded (25.665%) 2021-01-27T16:44:22.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.533199+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:22.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.542770+0000 mon.a (mon.0) 758 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:44:22.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.543076+0000 mon.a (mon.0) 759 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:22.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.543184+0000 mon.a (mon.0) 760 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:21.543282+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T16:44:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: audit 2021-01-27T16:44:21.545575+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: audit 2021-01-27T16:44:21.546921+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:44:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: audit 2021-01-27T16:44:21.547530+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:22.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: audit 2021-01-27T16:44:21.790777+0000 mgr.y (mgr.14138) 523 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:22.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[9795]: cluster 2021-01-27T16:44:22.544737+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T16:44:22.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.529132+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v419: 212 pgs: 39 active+undersized, 28 undersized+peered, 13 active+undersized+degraded, 8 undersized+degraded+peered, 29 peering, 1 stale+creating+peering, 17 stale+active+clean, 25 activating+undersized, 4 active+clean+wait, 48 active+clean; 25 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 203 B/s wr, 0 op/s; 251/978 objects degraded (25.665%) 2021-01-27T16:44:22.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.533199+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:22.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.542770+0000 mon.a (mon.0) 758 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:44:22.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.543076+0000 mon.a (mon.0) 759 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:22.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.543184+0000 mon.a (mon.0) 760 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:22.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:21.543282+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T16:44:22.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: audit 2021-01-27T16:44:21.545575+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:22.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: audit 2021-01-27T16:44:21.546921+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:44:22.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: audit 2021-01-27T16:44:21.547530+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:22.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: audit 2021-01-27T16:44:21.790777+0000 mgr.y (mgr.14138) 523 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:22.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:22 smithi106 bash[13484]: cluster 2021-01-27T16:44:22.544737+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T16:44:23.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.529132+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v419: 212 pgs: 39 active+undersized, 28 undersized+peered, 13 active+undersized+degraded, 8 undersized+degraded+peered, 29 peering, 1 stale+creating+peering, 17 stale+active+clean, 25 activating+undersized, 4 active+clean+wait, 48 active+clean; 25 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 203 B/s wr, 0 op/s; 251/978 objects degraded (25.665%) 2021-01-27T16:44:23.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.533199+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.542770+0000 mon.a (mon.0) 758 : cluster [INF] osd.1 [v2:172.21.15.106:6810/3792678646,v1:172.21.15.106:6811/3792678646] boot 2021-01-27T16:44:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.543076+0000 mon.a (mon.0) 759 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.543184+0000 mon.a (mon.0) 760 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:21.543282+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-27T16:44:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: audit 2021-01-27T16:44:21.545575+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:23.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: audit 2021-01-27T16:44:21.546921+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-27T16:44:23.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: audit 2021-01-27T16:44:21.547530+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:23.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: audit 2021-01-27T16:44:21.790777+0000 mgr.y (mgr.14138) 523 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:23.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:22 smithi094 bash[9811]: cluster 2021-01-27T16:44:22.544737+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-27T16:44:23.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:23 smithi106 bash[9795]: audit 2021-01-27T16:44:23.479598+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:23.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:23 smithi106 bash[13484]: audit 2021-01-27T16:44:23.479598+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:24.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:23 smithi094 bash[9811]: audit 2021-01-27T16:44:23.479598+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:24.584 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb ... ok 2021-01-27T16:44:24.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[9795]: cluster 2021-01-27T16:44:23.530566+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v422: 212 pgs: 37 active+undersized, 16 undersized+peered, 11 active+undersized+degraded, 6 undersized+degraded+peered, 54 peering, 1 stale+creating+peering, 9 stale+active+clean, 4 activating+undersized, 4 active+clean+wait, 70 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 138/978 objects degraded (14.110%); 13 B/s, 0 objects/s recovering 2021-01-27T16:44:24.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[9795]: audit 2021-01-27T16:44:23.580439+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:24.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[9795]: cluster 2021-01-27T16:44:23.580599+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T16:44:24.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[13484]: cluster 2021-01-27T16:44:23.530566+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v422: 212 pgs: 37 active+undersized, 16 undersized+peered, 11 active+undersized+degraded, 6 undersized+degraded+peered, 54 peering, 1 stale+creating+peering, 9 stale+active+clean, 4 activating+undersized, 4 active+clean+wait, 70 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 138/978 objects degraded (14.110%); 13 B/s, 0 objects/s recovering 2021-01-27T16:44:24.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[13484]: audit 2021-01-27T16:44:23.580439+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:24.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:24 smithi106 bash[13484]: cluster 2021-01-27T16:44:23.580599+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T16:44:25.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:24 smithi094 bash[9811]: cluster 2021-01-27T16:44:23.530566+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v422: 212 pgs: 37 active+undersized, 16 undersized+peered, 11 active+undersized+degraded, 6 undersized+degraded+peered, 54 peering, 1 stale+creating+peering, 9 stale+active+clean, 4 activating+undersized, 4 active+clean+wait, 70 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 138/978 objects degraded (14.110%); 13 B/s, 0 objects/s recovering 2021-01-27T16:44:25.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:24 smithi094 bash[9811]: audit 2021-01-27T16:44:23.580439+0000 mon.a (mon.0) 767 : audit [INF] from='client.? 172.21.15.106:0/4139144294' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:25.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:24 smithi094 bash[9811]: cluster 2021-01-27T16:44:23.580599+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-27T16:44:25.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:25 smithi106 bash[9795]: cluster 2021-01-27T16:44:24.578818+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T16:44:25.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:25 smithi106 bash[13484]: cluster 2021-01-27T16:44:24.578818+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T16:44:26.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:25 smithi094 bash[9811]: cluster 2021-01-27T16:44:24.578818+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-27T16:44:26.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: cluster 2021-01-27T16:44:25.531820+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v425: 180 pgs: 11 active+undersized, 4 undersized+peered, 7 active+undersized+degraded, 1 undersized+degraded+peered, 37 peering, 24 active+clean+wait, 96 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s; 70/975 objects degraded (7.179%); 17 B/s, 0 objects/s recovering 2021-01-27T16:44:26.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: cluster 2021-01-27T16:44:25.589501+0000 mon.a (mon.0) 770 : cluster [WRN] Health check update: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:26.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: cluster 2021-01-27T16:44:25.589587+0000 mon.a (mon.0) 771 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2021-01-27T16:44:26.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: cluster 2021-01-27T16:44:25.589643+0000 mon.a (mon.0) 772 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:26.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: cluster 2021-01-27T16:44:25.606023+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T16:44:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: audit 2021-01-27T16:44:25.617886+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T16:44:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: audit 2021-01-27T16:44:25.619485+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: audit 2021-01-27T16:44:25.619988+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: audit 2021-01-27T16:44:25.758361+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:44:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[13484]: audit 2021-01-27T16:44:25.761866+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:44:26.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: cluster 2021-01-27T16:44:25.531820+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v425: 180 pgs: 11 active+undersized, 4 undersized+peered, 7 active+undersized+degraded, 1 undersized+degraded+peered, 37 peering, 24 active+clean+wait, 96 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s; 70/975 objects degraded (7.179%); 17 B/s, 0 objects/s recovering 2021-01-27T16:44:26.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: cluster 2021-01-27T16:44:25.589501+0000 mon.a (mon.0) 770 : cluster [WRN] Health check update: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:26.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: cluster 2021-01-27T16:44:25.589587+0000 mon.a (mon.0) 771 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2021-01-27T16:44:26.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: cluster 2021-01-27T16:44:25.589643+0000 mon.a (mon.0) 772 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:26.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: cluster 2021-01-27T16:44:25.606023+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T16:44:26.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: audit 2021-01-27T16:44:25.617886+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T16:44:26.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: audit 2021-01-27T16:44:25.619485+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:26.958 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: audit 2021-01-27T16:44:25.619988+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:26.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: audit 2021-01-27T16:44:25.758361+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:44:26.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: audit 2021-01-27T16:44:25.761866+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:44:26.959 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:26 smithi106 bash[9795]: debug 2021-01-27T16:44:26.616+0000 7fb35b430700 -1 mon.a@0(leader).osd e107 definitely_dead 0 2021-01-27T16:44:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: cluster 2021-01-27T16:44:25.531820+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v425: 180 pgs: 11 active+undersized, 4 undersized+peered, 7 active+undersized+degraded, 1 undersized+degraded+peered, 37 peering, 24 active+clean+wait, 96 active+clean; 25 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s; 70/975 objects degraded (7.179%); 17 B/s, 0 objects/s recovering 2021-01-27T16:44:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: cluster 2021-01-27T16:44:25.589501+0000 mon.a (mon.0) 770 : cluster [WRN] Health check update: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: cluster 2021-01-27T16:44:25.589587+0000 mon.a (mon.0) 771 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2021-01-27T16:44:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: cluster 2021-01-27T16:44:25.589643+0000 mon.a (mon.0) 772 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: cluster 2021-01-27T16:44:25.606023+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-27T16:44:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: audit 2021-01-27T16:44:25.617886+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-27T16:44:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: audit 2021-01-27T16:44:25.619485+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: audit 2021-01-27T16:44:25.619988+0000 mon.a (mon.0) 774 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-27T16:44:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: audit 2021-01-27T16:44:25.758361+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:44:27.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:26 smithi094 bash[9811]: audit 2021-01-27T16:44:25.761866+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:44:27.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[9795]: cluster 2021-01-27T16:44:26.603492+0000 mon.a (mon.0) 777 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:27.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[9795]: audit 2021-01-27T16:44:26.618463+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:27.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[9795]: cluster 2021-01-27T16:44:26.618637+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T16:44:27.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[9795]: audit 2021-01-27T16:44:26.621843+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:27.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[9795]: audit 2021-01-27T16:44:26.622738+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:27.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[13484]: cluster 2021-01-27T16:44:26.603492+0000 mon.a (mon.0) 777 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:27.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[13484]: audit 2021-01-27T16:44:26.618463+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:27.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[13484]: cluster 2021-01-27T16:44:26.618637+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T16:44:27.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[13484]: audit 2021-01-27T16:44:26.621843+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:27.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:27 smithi106 bash[13484]: audit 2021-01-27T16:44:26.622738+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:28.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:27 smithi094 bash[9811]: cluster 2021-01-27T16:44:26.603492+0000 mon.a (mon.0) 777 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-27T16:44:28.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:27 smithi094 bash[9811]: audit 2021-01-27T16:44:26.618463+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-27T16:44:28.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:27 smithi094 bash[9811]: cluster 2021-01-27T16:44:26.618637+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-27T16:44:28.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:27 smithi094 bash[9811]: audit 2021-01-27T16:44:26.621843+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:28.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:27 smithi094 bash[9811]: audit 2021-01-27T16:44:26.622738+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-27T16:44:28.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[13484]: cluster 2021-01-27T16:44:27.533081+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v428: 212 pgs: 3 creating+peering, 22 unknown, 34 active+clean+wait, 153 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:28.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[13484]: cluster 2021-01-27T16:44:27.618308+0000 mon.a (mon.0) 781 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:28.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[13484]: audit 2021-01-27T16:44:27.626634+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T16:44:28.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[13484]: cluster 2021-01-27T16:44:27.626748+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e108: 8 total, 5 up, 8 in 2021-01-27T16:44:28.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[13484]: cluster 2021-01-27T16:44:28.048794+0000 mon.a (mon.0) 784 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded) 2021-01-27T16:44:28.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[9795]: cluster 2021-01-27T16:44:27.533081+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v428: 212 pgs: 3 creating+peering, 22 unknown, 34 active+clean+wait, 153 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:28.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[9795]: cluster 2021-01-27T16:44:27.618308+0000 mon.a (mon.0) 781 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:28.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[9795]: audit 2021-01-27T16:44:27.626634+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T16:44:28.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[9795]: cluster 2021-01-27T16:44:27.626748+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e108: 8 total, 5 up, 8 in 2021-01-27T16:44:28.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:28 smithi106 bash[9795]: cluster 2021-01-27T16:44:28.048794+0000 mon.a (mon.0) 784 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded) 2021-01-27T16:44:29.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:28 smithi094 bash[9811]: cluster 2021-01-27T16:44:27.533081+0000 mgr.y (mgr.14138) 526 : cluster [DBG] pgmap v428: 212 pgs: 3 creating+peering, 22 unknown, 34 active+clean+wait, 153 active+clean; 25 KiB data, 102 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2021-01-27T16:44:29.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:28 smithi094 bash[9811]: cluster 2021-01-27T16:44:27.618308+0000 mon.a (mon.0) 781 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-27T16:44:29.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:28 smithi094 bash[9811]: audit 2021-01-27T16:44:27.626634+0000 mon.a (mon.0) 782 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-27T16:44:29.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:28 smithi094 bash[9811]: cluster 2021-01-27T16:44:27.626748+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e108: 8 total, 5 up, 8 in 2021-01-27T16:44:29.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:28 smithi094 bash[9811]: cluster 2021-01-27T16:44:28.048794+0000 mon.a (mon.0) 784 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/975 objects degraded (7.179%), 8 pgs degraded) 2021-01-27T16:44:29.454 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[16567]: debug 2021-01-27T16:44:29.060+0000 7f812f1ed700 -1 osd.0 109 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:29.954 INFO:journalctl@ceph.osd.0.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[16567]: debug 2021-01-27T16:44:29.636+0000 7f8122748700 -1 osd.0 110 osdmap NOUP flag is set, waiting for it to clear 2021-01-27T16:44:29.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[9795]: cluster 2021-01-27T16:44:28.625691+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T16:44:29.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[9795]: cluster 2021-01-27T16:44:28.888002+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:29.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[9795]: cluster 2021-01-27T16:44:28.888014+0000 osd.0 (osd.0) 6 : cluster [DBG] map e109 wrongly marked me down at e108 2021-01-27T16:44:29.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[9795]: cluster 2021-01-27T16:44:28.888653+0000 mon.a (mon.0) 786 : cluster [INF] osd.0 marked itself dead as of e109 2021-01-27T16:44:29.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[13484]: cluster 2021-01-27T16:44:28.625691+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T16:44:29.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[13484]: cluster 2021-01-27T16:44:28.888002+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:29.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[13484]: cluster 2021-01-27T16:44:28.888014+0000 osd.0 (osd.0) 6 : cluster [DBG] map e109 wrongly marked me down at e108 2021-01-27T16:44:29.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:29 smithi106 bash[13484]: cluster 2021-01-27T16:44:28.888653+0000 mon.a (mon.0) 786 : cluster [INF] osd.0 marked itself dead as of e109 2021-01-27T16:44:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:29 smithi094 bash[9811]: cluster 2021-01-27T16:44:28.625691+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-27T16:44:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:29 smithi094 bash[9811]: cluster 2021-01-27T16:44:28.888002+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-27T16:44:30.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:29 smithi094 bash[9811]: cluster 2021-01-27T16:44:28.888014+0000 osd.0 (osd.0) 6 : cluster [DBG] map e109 wrongly marked me down at e108 2021-01-27T16:44:30.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:29 smithi094 bash[9811]: cluster 2021-01-27T16:44:28.888653+0000 mon.a (mon.0) 786 : cluster [INF] osd.0 marked itself dead as of e109 2021-01-27T16:44:30.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: cluster 2021-01-27T16:44:29.534017+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v431: 212 pgs: 32 peering, 9 stale+active+clean+wait, 12 stale+active+clean, 3 creating+peering, 6 unknown, 18 active+clean+wait, 132 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:30.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: cluster 2021-01-27T16:44:29.637526+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T16:44:30.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.364811+0000 mon.a (mon.0) 788 : cluster [INF] osd.2 marked itself dead as of e110 2021-01-27T16:44:30.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.598057+0000 mon.a (mon.0) 789 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T16:44:30.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: audit 2021-01-27T16:44:30.631844+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:30.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[9795]: audit 2021-01-27T16:44:30.632325+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:30.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: cluster 2021-01-27T16:44:29.534017+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v431: 212 pgs: 32 peering, 9 stale+active+clean+wait, 12 stale+active+clean, 3 creating+peering, 6 unknown, 18 active+clean+wait, 132 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:30.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: cluster 2021-01-27T16:44:29.637526+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T16:44:30.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.364811+0000 mon.a (mon.0) 788 : cluster [INF] osd.2 marked itself dead as of e110 2021-01-27T16:44:30.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.598057+0000 mon.a (mon.0) 789 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T16:44:30.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: audit 2021-01-27T16:44:30.631844+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:30.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:30 smithi106 bash[13484]: audit 2021-01-27T16:44:30.632325+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: cluster 2021-01-27T16:44:29.534017+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v431: 212 pgs: 32 peering, 9 stale+active+clean+wait, 12 stale+active+clean, 3 creating+peering, 6 unknown, 18 active+clean+wait, 132 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: cluster 2021-01-27T16:44:29.637526+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-27T16:44:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.364811+0000 mon.a (mon.0) 788 : cluster [INF] osd.2 marked itself dead as of e110 2021-01-27T16:44:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.598057+0000 mon.a (mon.0) 789 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-27T16:44:31.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: audit 2021-01-27T16:44:30.631844+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:31.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:30 smithi094 bash[9811]: audit 2021-01-27T16:44:30.632325+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:31.954 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[10032]: debug 2021-01-27T16:44:31.796+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:31.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.363837+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:31.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.363846+0000 osd.2 (osd.2) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:31.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.599258+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:31.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.599262+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:31.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.634371+0000 mon.a (mon.0) 791 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:31.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: audit 2021-01-27T16:44:30.642711+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:31.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[9795]: cluster 2021-01-27T16:44:30.643329+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T16:44:31.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.363837+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:31.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.363846+0000 osd.2 (osd.2) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:31.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.599258+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:31.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.599262+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:31.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.634371+0000 mon.a (mon.0) 791 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:31.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: audit 2021-01-27T16:44:30.642711+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:31.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:31 smithi106 bash[13484]: cluster 2021-01-27T16:44:30.643329+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T16:44:32.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:32.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.363837+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-27T16:44:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.363846+0000 osd.2 (osd.2) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.599258+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-27T16:44:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.599262+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e108 2021-01-27T16:44:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.634371+0000 mon.a (mon.0) 791 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-27T16:44:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: audit 2021-01-27T16:44:30.642711+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:32.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:31 smithi094 bash[9811]: cluster 2021-01-27T16:44:30.643329+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-27T16:44:32.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.535567+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v434: 212 pgs: 4 undersized+degraded+peered, 10 active+undersized+degraded, 17 undersized+peered+wait, 19 active+undersized+wait, 10 undersized+peered, 30 active+undersized, 9 active+undersized+degraded+wait, 6 undersized+degraded+peered+wait, 32 peering, 3 stale+active+clean+wait, 13 stale+active+clean, 9 active+clean+wait, 50 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 256/975 objects degraded (26.256%) 2021-01-27T16:44:32.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.651756+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:32.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.651818+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:32.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.652742+0000 mon.a (mon.0) 796 : cluster [WRN] Health check failed: Degraded data redundancy: 256/975 objects degraded (26.256%), 29 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:32.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.661356+0000 mon.a (mon.0) 797 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:32.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.662104+0000 mon.a (mon.0) 798 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:32.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.662198+0000 mon.a (mon.0) 799 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:32.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: cluster 2021-01-27T16:44:31.662261+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T16:44:32.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: audit 2021-01-27T16:44:31.664419+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:32.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: audit 2021-01-27T16:44:31.665028+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:32.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: audit 2021-01-27T16:44:31.665678+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:32.957 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[9795]: audit 2021-01-27T16:44:31.802069+0000 mgr.y (mgr.14138) 529 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:32.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.535567+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v434: 212 pgs: 4 undersized+degraded+peered, 10 active+undersized+degraded, 17 undersized+peered+wait, 19 active+undersized+wait, 10 undersized+peered, 30 active+undersized, 9 active+undersized+degraded+wait, 6 undersized+degraded+peered+wait, 32 peering, 3 stale+active+clean+wait, 13 stale+active+clean, 9 active+clean+wait, 50 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 256/975 objects degraded (26.256%) 2021-01-27T16:44:32.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.651756+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:32.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.651818+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:32.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.652742+0000 mon.a (mon.0) 796 : cluster [WRN] Health check failed: Degraded data redundancy: 256/975 objects degraded (26.256%), 29 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:32.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.661356+0000 mon.a (mon.0) 797 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:32.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.662104+0000 mon.a (mon.0) 798 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:32.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.662198+0000 mon.a (mon.0) 799 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:32.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: cluster 2021-01-27T16:44:31.662261+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T16:44:32.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: audit 2021-01-27T16:44:31.664419+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:32.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: audit 2021-01-27T16:44:31.665028+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:32.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: audit 2021-01-27T16:44:31.665678+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:32.960 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:32 smithi106 bash[13484]: audit 2021-01-27T16:44:31.802069+0000 mgr.y (mgr.14138) 529 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:33.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.535567+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v434: 212 pgs: 4 undersized+degraded+peered, 10 active+undersized+degraded, 17 undersized+peered+wait, 19 active+undersized+wait, 10 undersized+peered, 30 active+undersized, 9 active+undersized+degraded+wait, 6 undersized+degraded+peered+wait, 32 peering, 3 stale+active+clean+wait, 13 stale+active+clean, 9 active+clean+wait, 50 active+clean; 25 KiB data, 104 MiB used, 715 GiB / 715 GiB avail; 256/975 objects degraded (26.256%) 2021-01-27T16:44:33.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.651756+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-27T16:44:33.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.651818+0000 mon.a (mon.0) 795 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:33.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.652742+0000 mon.a (mon.0) 796 : cluster [WRN] Health check failed: Degraded data redundancy: 256/975 objects degraded (26.256%), 29 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:33.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.661356+0000 mon.a (mon.0) 797 : cluster [INF] osd.0 [v2:172.21.15.106:6802/2604730968,v1:172.21.15.106:6803/2604730968] boot 2021-01-27T16:44:33.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.662104+0000 mon.a (mon.0) 798 : cluster [INF] osd.4 [v2:172.21.15.94:6800/4275584131,v1:172.21.15.94:6801/4275584131] boot 2021-01-27T16:44:33.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.662198+0000 mon.a (mon.0) 799 : cluster [INF] osd.2 [v2:172.21.15.106:6818/2900657738,v1:172.21.15.106:6819/2900657738] boot 2021-01-27T16:44:33.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: cluster 2021-01-27T16:44:31.662261+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-27T16:44:33.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: audit 2021-01-27T16:44:31.664419+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-27T16:44:33.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: audit 2021-01-27T16:44:31.665028+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-27T16:44:33.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: audit 2021-01-27T16:44:31.665678+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-27T16:44:33.039 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:32 smithi094 bash[9811]: audit 2021-01-27T16:44:31.802069+0000 mgr.y (mgr.14138) 529 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:33.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:33 smithi106 bash[13484]: cluster 2021-01-27T16:44:32.668469+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T16:44:33.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:33 smithi106 bash[9795]: cluster 2021-01-27T16:44:32.668469+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T16:44:34.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:33 smithi094 bash[9811]: cluster 2021-01-27T16:44:32.668469+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-27T16:44:34.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[9795]: cluster 2021-01-27T16:44:33.536805+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v437: 212 pgs: 3 undersized+degraded+peered, 6 active+undersized+degraded, 10 undersized+peered+wait, 14 active+undersized+wait, 4 undersized+peered, 23 active+undersized, 7 active+undersized+degraded+wait, 2 undersized+degraded+peered+wait, 70 peering, 3 stale+active+clean, 26 active+clean+wait, 44 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 123/975 objects degraded (12.615%) 2021-01-27T16:44:34.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[9795]: audit 2021-01-27T16:44:34.611202+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:34.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[9795]: audit 2021-01-27T16:44:34.612012+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:34.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[13484]: cluster 2021-01-27T16:44:33.536805+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v437: 212 pgs: 3 undersized+degraded+peered, 6 active+undersized+degraded, 10 undersized+peered+wait, 14 active+undersized+wait, 4 undersized+peered, 23 active+undersized, 7 active+undersized+degraded+wait, 2 undersized+degraded+peered+wait, 70 peering, 3 stale+active+clean, 26 active+clean+wait, 44 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 123/975 objects degraded (12.615%) 2021-01-27T16:44:34.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[13484]: audit 2021-01-27T16:44:34.611202+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:34.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:34 smithi106 bash[13484]: audit 2021-01-27T16:44:34.612012+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:35.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:34 smithi094 bash[9811]: cluster 2021-01-27T16:44:33.536805+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v437: 212 pgs: 3 undersized+degraded+peered, 6 active+undersized+degraded, 10 undersized+peered+wait, 14 active+undersized+wait, 4 undersized+peered, 23 active+undersized, 7 active+undersized+degraded+wait, 2 undersized+degraded+peered+wait, 70 peering, 3 stale+active+clean, 26 active+clean+wait, 44 active+clean; 25 KiB data, 106 MiB used, 715 GiB / 715 GiB avail; 123/975 objects degraded (12.615%) 2021-01-27T16:44:35.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:34 smithi094 bash[9811]: audit 2021-01-27T16:44:34.611202+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.106:0/2548706157' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:35.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:34 smithi094 bash[9811]: audit 2021-01-27T16:44:34.612012+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:35.708 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb_error ... ok 2021-01-27T16:44:36.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:35 smithi094 bash[9811]: audit 2021-01-27T16:44:34.698519+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:36.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:35 smithi094 bash[9811]: cluster 2021-01-27T16:44:34.698687+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T16:44:36.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:35 smithi106 bash[9795]: audit 2021-01-27T16:44:34.698519+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:36.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:35 smithi106 bash[9795]: cluster 2021-01-27T16:44:34.698687+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T16:44:36.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:35 smithi106 bash[13484]: audit 2021-01-27T16:44:34.698519+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:36.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:35 smithi106 bash[13484]: cluster 2021-01-27T16:44:34.698687+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-27T16:44:37.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:36 smithi094 bash[9811]: cluster 2021-01-27T16:44:35.538070+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v439: 212 pgs: 2 undersized+degraded+peered, 3 active+undersized+degraded, 1 undersized+peered, 13 active+undersized, 66 peering, 23 active+clean+wait, 104 active+clean; 25 KiB data, 111 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 56/975 objects degraded (5.744%); 9 B/s, 0 objects/s recovering 2021-01-27T16:44:37.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:36 smithi094 bash[9811]: cluster 2021-01-27T16:44:35.703850+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T16:44:37.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:36 smithi106 bash[13484]: cluster 2021-01-27T16:44:35.538070+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v439: 212 pgs: 2 undersized+degraded+peered, 3 active+undersized+degraded, 1 undersized+peered, 13 active+undersized, 66 peering, 23 active+clean+wait, 104 active+clean; 25 KiB data, 111 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 56/975 objects degraded (5.744%); 9 B/s, 0 objects/s recovering 2021-01-27T16:44:37.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:36 smithi106 bash[13484]: cluster 2021-01-27T16:44:35.703850+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T16:44:37.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:36 smithi106 bash[9795]: cluster 2021-01-27T16:44:35.538070+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v439: 212 pgs: 2 undersized+degraded+peered, 3 active+undersized+degraded, 1 undersized+peered, 13 active+undersized, 66 peering, 23 active+clean+wait, 104 active+clean; 25 KiB data, 111 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 56/975 objects degraded (5.744%); 9 B/s, 0 objects/s recovering 2021-01-27T16:44:37.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:36 smithi106 bash[9795]: cluster 2021-01-27T16:44:35.703850+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-27T16:44:38.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:37 smithi094 bash[9811]: cluster 2021-01-27T16:44:36.726240+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T16:44:38.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:37 smithi094 bash[9811]: cluster 2021-01-27T16:44:37.049009+0000 mon.a (mon.0) 810 : cluster [WRN] Health check update: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:38.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:37 smithi106 bash[13484]: cluster 2021-01-27T16:44:36.726240+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T16:44:38.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:37 smithi106 bash[13484]: cluster 2021-01-27T16:44:37.049009+0000 mon.a (mon.0) 810 : cluster [WRN] Health check update: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:38.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:37 smithi106 bash[9795]: cluster 2021-01-27T16:44:36.726240+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-27T16:44:38.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:37 smithi106 bash[9795]: cluster 2021-01-27T16:44:37.049009+0000 mon.a (mon.0) 810 : cluster [WRN] Health check update: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded (PG_DEGRADED) 2021-01-27T16:44:39.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: cluster 2021-01-27T16:44:37.539266+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v442: 212 pgs: 10 creating+peering, 22 unknown, 18 peering, 28 active+clean+wait, 134 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 9 B/s, 0 objects/s recovering 2021-01-27T16:44:39.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: cluster 2021-01-27T16:44:37.732601+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T16:44:39.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: audit 2021-01-27T16:44:37.793171+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.106:0/1970451633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: audit 2021-01-27T16:44:37.793657+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: cluster 2021-01-27T16:44:38.052097+0000 mon.a (mon.0) 813 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded) 2021-01-27T16:44:39.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:38 smithi094 bash[9811]: cluster 2021-01-27T16:44:38.052156+0000 mon.a (mon.0) 814 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:39.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: cluster 2021-01-27T16:44:37.539266+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v442: 212 pgs: 10 creating+peering, 22 unknown, 18 peering, 28 active+clean+wait, 134 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 9 B/s, 0 objects/s recovering 2021-01-27T16:44:39.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: cluster 2021-01-27T16:44:37.732601+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T16:44:39.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: audit 2021-01-27T16:44:37.793171+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.106:0/1970451633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: audit 2021-01-27T16:44:37.793657+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: cluster 2021-01-27T16:44:38.052097+0000 mon.a (mon.0) 813 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded) 2021-01-27T16:44:39.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[9795]: cluster 2021-01-27T16:44:38.052156+0000 mon.a (mon.0) 814 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:39.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: cluster 2021-01-27T16:44:37.539266+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v442: 212 pgs: 10 creating+peering, 22 unknown, 18 peering, 28 active+clean+wait, 134 active+clean; 25 KiB data, 112 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s; 9 B/s, 0 objects/s recovering 2021-01-27T16:44:39.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: cluster 2021-01-27T16:44:37.732601+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-27T16:44:39.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: audit 2021-01-27T16:44:37.793171+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.106:0/1970451633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: audit 2021-01-27T16:44:37.793657+0000 mon.a (mon.0) 812 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:39.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: cluster 2021-01-27T16:44:38.052097+0000 mon.a (mon.0) 813 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/975 objects degraded (5.744%), 5 pgs degraded) 2021-01-27T16:44:39.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:38 smithi106 bash[13484]: cluster 2021-01-27T16:44:38.052156+0000 mon.a (mon.0) 814 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:39.764 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_remove ... ok 2021-01-27T16:44:40.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:39 smithi094 bash[9811]: audit 2021-01-27T16:44:38.754868+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:40.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:39 smithi094 bash[9811]: cluster 2021-01-27T16:44:38.754995+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T16:44:40.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:39 smithi106 bash[9795]: audit 2021-01-27T16:44:38.754868+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:40.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:39 smithi106 bash[9795]: cluster 2021-01-27T16:44:38.754995+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T16:44:40.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:39 smithi106 bash[13484]: audit 2021-01-27T16:44:38.754868+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:40.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:39 smithi106 bash[13484]: cluster 2021-01-27T16:44:38.754995+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-27T16:44:41.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:40 smithi094 bash[9811]: cluster 2021-01-27T16:44:39.540201+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v445: 212 pgs: 11 creating+peering, 12 unknown, 28 active+clean+wait, 161 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:41.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:40 smithi094 bash[9811]: cluster 2021-01-27T16:44:39.760082+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T16:44:41.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:40 smithi106 bash[13484]: cluster 2021-01-27T16:44:39.540201+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v445: 212 pgs: 11 creating+peering, 12 unknown, 28 active+clean+wait, 161 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:41.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:40 smithi106 bash[13484]: cluster 2021-01-27T16:44:39.760082+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T16:44:41.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:40 smithi106 bash[9795]: cluster 2021-01-27T16:44:39.540201+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v445: 212 pgs: 11 creating+peering, 12 unknown, 28 active+clean+wait, 161 active+clean; 25 KiB data, 117 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:41.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:40 smithi106 bash[9795]: cluster 2021-01-27T16:44:39.760082+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-27T16:44:42.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:41 smithi106 bash[10032]: debug 2021-01-27T16:44:41.807+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:42.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:41 smithi106 bash[13484]: cluster 2021-01-27T16:44:40.781955+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T16:44:42.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:41 smithi106 bash[9795]: cluster 2021-01-27T16:44:40.781955+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T16:44:42.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:42.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:41 smithi094 bash[9811]: cluster 2021-01-27T16:44:40.781955+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-27T16:44:43.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: cluster 2021-01-27T16:44:41.541235+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v448: 212 pgs: 6 creating+peering, 26 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:43.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: cluster 2021-01-27T16:44:41.786578+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T16:44:43.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: audit 2021-01-27T16:44:41.813875+0000 mgr.y (mgr.14138) 535 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:43.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: audit 2021-01-27T16:44:41.826012+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:43.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: audit 2021-01-27T16:44:42.788595+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:43.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[13484]: cluster 2021-01-27T16:44:42.788702+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T16:44:43.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: cluster 2021-01-27T16:44:41.541235+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v448: 212 pgs: 6 creating+peering, 26 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:43.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: cluster 2021-01-27T16:44:41.786578+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T16:44:43.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: audit 2021-01-27T16:44:41.813875+0000 mgr.y (mgr.14138) 535 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:43.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: audit 2021-01-27T16:44:41.826012+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:43.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: audit 2021-01-27T16:44:42.788595+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:43.207 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:42 smithi106 bash[9795]: cluster 2021-01-27T16:44:42.788702+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T16:44:43.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: cluster 2021-01-27T16:44:41.541235+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v448: 212 pgs: 6 creating+peering, 26 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:43.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: cluster 2021-01-27T16:44:41.786578+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-27T16:44:43.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: audit 2021-01-27T16:44:41.813875+0000 mgr.y (mgr.14138) 535 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:43.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: audit 2021-01-27T16:44:41.826012+0000 mon.a (mon.0) 820 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:43.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: audit 2021-01-27T16:44:42.788595+0000 mon.a (mon.0) 821 : audit [INF] from='client.? 172.21.15.106:0/3396314740' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:43.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:42 smithi094 bash[9811]: cluster 2021-01-27T16:44:42.788702+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-27T16:44:43.795 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_rmxattr ... ok 2021-01-27T16:44:45.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:44 smithi106 bash[9795]: cluster 2021-01-27T16:44:43.542227+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v451: 212 pgs: 6 creating+peering, 7 unknown, 28 active+clean+wait, 171 active+clean; 25 KiB data, 126 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:45.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:44 smithi106 bash[9795]: cluster 2021-01-27T16:44:43.790859+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T16:44:45.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:44 smithi106 bash[13484]: cluster 2021-01-27T16:44:43.542227+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v451: 212 pgs: 6 creating+peering, 7 unknown, 28 active+clean+wait, 171 active+clean; 25 KiB data, 126 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:45.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:44 smithi106 bash[13484]: cluster 2021-01-27T16:44:43.790859+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T16:44:45.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:44 smithi094 bash[9811]: cluster 2021-01-27T16:44:43.542227+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v451: 212 pgs: 6 creating+peering, 7 unknown, 28 active+clean+wait, 171 active+clean; 25 KiB data, 126 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:45.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:44 smithi094 bash[9811]: cluster 2021-01-27T16:44:43.790859+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-27T16:44:46.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:45 smithi106 bash[9795]: cluster 2021-01-27T16:44:44.815407+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T16:44:46.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:45 smithi106 bash[13484]: cluster 2021-01-27T16:44:44.815407+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T16:44:46.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:45 smithi094 bash[9811]: cluster 2021-01-27T16:44:44.815407+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-27T16:44:47.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: cluster 2021-01-27T16:44:45.543457+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v454: 212 pgs: 12 creating+peering, 20 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:47.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: cluster 2021-01-27T16:44:45.821367+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T16:44:47.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: audit 2021-01-27T16:44:45.859269+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.106:0/1236840378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: audit 2021-01-27T16:44:45.859580+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: audit 2021-01-27T16:44:46.822394+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:47.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[9795]: cluster 2021-01-27T16:44:46.822589+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T16:44:47.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: cluster 2021-01-27T16:44:45.543457+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v454: 212 pgs: 12 creating+peering, 20 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:47.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: cluster 2021-01-27T16:44:45.821367+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T16:44:47.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: audit 2021-01-27T16:44:45.859269+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.106:0/1236840378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: audit 2021-01-27T16:44:45.859580+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: audit 2021-01-27T16:44:46.822394+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:47.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:46 smithi106 bash[13484]: cluster 2021-01-27T16:44:46.822589+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T16:44:47.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: cluster 2021-01-27T16:44:45.543457+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v454: 212 pgs: 12 creating+peering, 20 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 131 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:47.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: cluster 2021-01-27T16:44:45.821367+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-27T16:44:47.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: audit 2021-01-27T16:44:45.859269+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.106:0/1236840378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: audit 2021-01-27T16:44:45.859580+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:47.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: audit 2021-01-27T16:44:46.822394+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:47.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:46 smithi094 bash[9811]: cluster 2021-01-27T16:44:46.822589+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-27T16:44:47.832 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_setxattr ... ok 2021-01-27T16:44:49.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[13484]: cluster 2021-01-27T16:44:47.544631+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v457: 212 pgs: 12 creating+peering, 8 unknown, 16 active+clean+wait, 176 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T16:44:49.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[13484]: cluster 2021-01-27T16:44:47.825445+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T16:44:49.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[13484]: cluster 2021-01-27T16:44:48.289857+0000 mon.a (mon.0) 830 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:49.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[9795]: cluster 2021-01-27T16:44:47.544631+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v457: 212 pgs: 12 creating+peering, 8 unknown, 16 active+clean+wait, 176 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T16:44:49.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[9795]: cluster 2021-01-27T16:44:47.825445+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T16:44:49.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:48 smithi106 bash[9795]: cluster 2021-01-27T16:44:48.289857+0000 mon.a (mon.0) 830 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:49.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:48 smithi094 bash[9811]: cluster 2021-01-27T16:44:47.544631+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v457: 212 pgs: 12 creating+peering, 8 unknown, 16 active+clean+wait, 176 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-27T16:44:49.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:48 smithi094 bash[9811]: cluster 2021-01-27T16:44:47.825445+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-27T16:44:49.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:48 smithi094 bash[9811]: cluster 2021-01-27T16:44:48.289857+0000 mon.a (mon.0) 830 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:44:50.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:49 smithi106 bash[9795]: cluster 2021-01-27T16:44:48.835195+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T16:44:50.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:49 smithi106 bash[13484]: cluster 2021-01-27T16:44:48.835195+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T16:44:50.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:49 smithi094 bash[9811]: cluster 2021-01-27T16:44:48.835195+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-27T16:44:51.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: cluster 2021-01-27T16:44:49.545563+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:51.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: cluster 2021-01-27T16:44:49.830351+0000 mon.a (mon.0) 832 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:51.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: cluster 2021-01-27T16:44:49.830415+0000 mon.a (mon.0) 833 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:51.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: cluster 2021-01-27T16:44:49.838671+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T16:44:51.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: audit 2021-01-27T16:44:50.359381+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.106:0/4162120265' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[9795]: audit 2021-01-27T16:44:50.359854+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: cluster 2021-01-27T16:44:49.545563+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:51.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: cluster 2021-01-27T16:44:49.830351+0000 mon.a (mon.0) 832 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:51.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: cluster 2021-01-27T16:44:49.830415+0000 mon.a (mon.0) 833 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:51.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: cluster 2021-01-27T16:44:49.838671+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T16:44:51.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: audit 2021-01-27T16:44:50.359381+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.106:0/4162120265' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:50 smithi106 bash[13484]: audit 2021-01-27T16:44:50.359854+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: cluster 2021-01-27T16:44:49.545563+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:44:51.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: cluster 2021-01-27T16:44:49.830351+0000 mon.a (mon.0) 832 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:44:51.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: cluster 2021-01-27T16:44:49.830415+0000 mon.a (mon.0) 833 : cluster [INF] Cluster is now healthy 2021-01-27T16:44:51.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: cluster 2021-01-27T16:44:49.838671+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-27T16:44:51.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: audit 2021-01-27T16:44:50.359381+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.106:0/4162120265' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:50 smithi094 bash[9811]: audit 2021-01-27T16:44:50.359854+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:51.881 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_stat ... ok 2021-01-27T16:44:52.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:44:51 smithi106 bash[10032]: debug 2021-01-27T16:44:51.823+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:44:52.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:51 smithi106 bash[9795]: audit 2021-01-27T16:44:50.856729+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:52.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:51 smithi106 bash[9795]: cluster 2021-01-27T16:44:50.856947+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T16:44:52.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:51 smithi106 bash[13484]: audit 2021-01-27T16:44:50.856729+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:52.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:51 smithi106 bash[13484]: cluster 2021-01-27T16:44:50.856947+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T16:44:52.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:44:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:44:52.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:51 smithi094 bash[9811]: audit 2021-01-27T16:44:50.856729+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:52.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:51 smithi094 bash[9811]: cluster 2021-01-27T16:44:50.856947+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-27T16:44:53.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[9795]: cluster 2021-01-27T16:44:51.546605+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v463: 212 pgs: 2 creating+activating, 4 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:44:53.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[9795]: audit 2021-01-27T16:44:51.824988+0000 mgr.y (mgr.14138) 541 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:53.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[9795]: cluster 2021-01-27T16:44:51.877589+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T16:44:53.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[13484]: cluster 2021-01-27T16:44:51.546605+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v463: 212 pgs: 2 creating+activating, 4 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:44:53.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[13484]: audit 2021-01-27T16:44:51.824988+0000 mgr.y (mgr.14138) 541 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:53.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:52 smithi106 bash[13484]: cluster 2021-01-27T16:44:51.877589+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T16:44:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:52 smithi094 bash[9811]: cluster 2021-01-27T16:44:51.546605+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v463: 212 pgs: 2 creating+activating, 4 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 137 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:44:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:52 smithi094 bash[9811]: audit 2021-01-27T16:44:51.824988+0000 mgr.y (mgr.14138) 541 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:44:53.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:52 smithi094 bash[9811]: cluster 2021-01-27T16:44:51.877589+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-27T16:44:54.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:53 smithi106 bash[9795]: cluster 2021-01-27T16:44:52.890896+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T16:44:54.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:53 smithi106 bash[13484]: cluster 2021-01-27T16:44:52.890896+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T16:44:54.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:53 smithi094 bash[9811]: cluster 2021-01-27T16:44:52.890896+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-27T16:44:55.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[9795]: cluster 2021-01-27T16:44:53.547642+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v466: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:55.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[9795]: cluster 2021-01-27T16:44:53.893019+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T16:44:55.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[9795]: audit 2021-01-27T16:44:53.949802+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:55.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[13484]: cluster 2021-01-27T16:44:53.547642+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v466: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:55.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[13484]: cluster 2021-01-27T16:44:53.893019+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T16:44:55.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:54 smithi106 bash[13484]: audit 2021-01-27T16:44:53.949802+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:55.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:54 smithi094 bash[9811]: cluster 2021-01-27T16:44:53.547642+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v466: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:55.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:54 smithi094 bash[9811]: cluster 2021-01-27T16:44:53.893019+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-27T16:44:55.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:54 smithi094 bash[9811]: audit 2021-01-27T16:44:53.949802+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:55.923 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_write ... ok 2021-01-27T16:44:56.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:55 smithi106 bash[9795]: audit 2021-01-27T16:44:54.911490+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:56.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:55 smithi106 bash[9795]: cluster 2021-01-27T16:44:54.911718+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T16:44:56.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:55 smithi106 bash[13484]: audit 2021-01-27T16:44:54.911490+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:56.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:55 smithi106 bash[13484]: cluster 2021-01-27T16:44:54.911718+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T16:44:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:55 smithi094 bash[9811]: audit 2021-01-27T16:44:54.911490+0000 mon.a (mon.0) 842 : audit [INF] from='client.? 172.21.15.106:0/462792890' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:44:56.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:55 smithi094 bash[9811]: cluster 2021-01-27T16:44:54.911718+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-27T16:44:57.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:56 smithi106 bash[9795]: cluster 2021-01-27T16:44:55.548887+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v469: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:57.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:56 smithi106 bash[9795]: cluster 2021-01-27T16:44:55.916260+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T16:44:57.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:56 smithi106 bash[13484]: cluster 2021-01-27T16:44:55.548887+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v469: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:57.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:56 smithi106 bash[13484]: cluster 2021-01-27T16:44:55.916260+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T16:44:57.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:56 smithi094 bash[9811]: cluster 2021-01-27T16:44:55.548887+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v469: 212 pgs: 3 creating+peering, 19 unknown, 190 active+clean; 25 KiB data, 138 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:44:57.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:56 smithi094 bash[9811]: cluster 2021-01-27T16:44:55.916260+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-27T16:44:58.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:57 smithi094 bash[9811]: cluster 2021-01-27T16:44:56.943130+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T16:44:58.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:57 smithi106 bash[9795]: cluster 2021-01-27T16:44:56.943130+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T16:44:58.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:57 smithi106 bash[13484]: cluster 2021-01-27T16:44:56.943130+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-27T16:44:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:58 smithi094 bash[9811]: cluster 2021-01-27T16:44:57.550078+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v472: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:59.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:58 smithi094 bash[9811]: cluster 2021-01-27T16:44:57.952087+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T16:44:59.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:58 smithi094 bash[9811]: audit 2021-01-27T16:44:58.010598+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.106:0/951836818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:58 smithi094 bash[9811]: audit 2021-01-27T16:44:58.011056+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[9795]: cluster 2021-01-27T16:44:57.550078+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v472: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:59.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[9795]: cluster 2021-01-27T16:44:57.952087+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T16:44:59.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[9795]: audit 2021-01-27T16:44:58.010598+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.106:0/951836818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[9795]: audit 2021-01-27T16:44:58.011056+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[13484]: cluster 2021-01-27T16:44:57.550078+0000 mgr.y (mgr.14138) 544 : cluster [DBG] pgmap v472: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 143 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:44:59.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[13484]: cluster 2021-01-27T16:44:57.952087+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-27T16:44:59.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[13484]: audit 2021-01-27T16:44:58.010598+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.106:0/951836818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:58 smithi106 bash[13484]: audit 2021-01-27T16:44:58.011056+0000 mon.a (mon.0) 847 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:44:59.986 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_write_full ... ok 2021-01-27T16:45:00.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:59 smithi094 bash[9811]: audit 2021-01-27T16:44:58.967533+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:00.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:44:59 smithi094 bash[9811]: cluster 2021-01-27T16:44:58.967705+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T16:45:00.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:59 smithi106 bash[9795]: audit 2021-01-27T16:44:58.967533+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:00.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:44:59 smithi106 bash[9795]: cluster 2021-01-27T16:44:58.967705+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T16:45:00.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:59 smithi106 bash[13484]: audit 2021-01-27T16:44:58.967533+0000 mon.a (mon.0) 848 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:00.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:44:59 smithi106 bash[13484]: cluster 2021-01-27T16:44:58.967705+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-27T16:45:01.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:00 smithi094 bash[9811]: cluster 2021-01-27T16:44:59.551128+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v475: 212 pgs: 12 creating+peering, 14 unknown, 186 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:01.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:00 smithi094 bash[9811]: cluster 2021-01-27T16:44:59.981792+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T16:45:01.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:00 smithi106 bash[9795]: cluster 2021-01-27T16:44:59.551128+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v475: 212 pgs: 12 creating+peering, 14 unknown, 186 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:01.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:00 smithi106 bash[9795]: cluster 2021-01-27T16:44:59.981792+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T16:45:01.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:00 smithi106 bash[13484]: cluster 2021-01-27T16:44:59.551128+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v475: 212 pgs: 12 creating+peering, 14 unknown, 186 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:01.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:00 smithi106 bash[13484]: cluster 2021-01-27T16:44:59.981792+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-27T16:45:02.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:02 smithi106 bash[9795]: cluster 2021-01-27T16:45:01.008691+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T16:45:02.205 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:01 smithi106 bash[10032]: debug 2021-01-27T16:45:01.835+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:02.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:02 smithi106 bash[13484]: cluster 2021-01-27T16:45:01.008691+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T16:45:02.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:02 smithi094 bash[9811]: cluster 2021-01-27T16:45:01.008691+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-27T16:45:02.287 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:03.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[9795]: cluster 2021-01-27T16:45:01.552286+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v478: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:03.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[9795]: audit 2021-01-27T16:45:01.836257+0000 mgr.y (mgr.14138) 547 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:03.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[9795]: cluster 2021-01-27T16:45:02.011138+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T16:45:03.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[9795]: audit 2021-01-27T16:45:02.076587+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.106:0/3754832744' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:03.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[9795]: audit 2021-01-27T16:45:02.077203+0000 mon.a (mon.0) 853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:03.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[13484]: cluster 2021-01-27T16:45:01.552286+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v478: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:03.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[13484]: audit 2021-01-27T16:45:01.836257+0000 mgr.y (mgr.14138) 547 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:03.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[13484]: cluster 2021-01-27T16:45:02.011138+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T16:45:03.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[13484]: audit 2021-01-27T16:45:02.076587+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.106:0/3754832744' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:03.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:03 smithi106 bash[13484]: audit 2021-01-27T16:45:02.077203+0000 mon.a (mon.0) 853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:03.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:03 smithi094 bash[9811]: cluster 2021-01-27T16:45:01.552286+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v478: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:03.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:03 smithi094 bash[9811]: audit 2021-01-27T16:45:01.836257+0000 mgr.y (mgr.14138) 547 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:03.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:03 smithi094 bash[9811]: cluster 2021-01-27T16:45:02.011138+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-27T16:45:03.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:03 smithi094 bash[9811]: audit 2021-01-27T16:45:02.076587+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.106:0/3754832744' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:03.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:03 smithi094 bash[9811]: audit 2021-01-27T16:45:02.077203+0000 mon.a (mon.0) 853 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:04.039 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_write_no_comp_ref ... ok 2021-01-27T16:45:04.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[9795]: audit 2021-01-27T16:45:03.035972+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:04.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[9795]: cluster 2021-01-27T16:45:03.036164+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T16:45:04.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[9795]: cluster 2021-01-27T16:45:04.035052+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T16:45:04.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[13484]: audit 2021-01-27T16:45:03.035972+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:04.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[13484]: cluster 2021-01-27T16:45:03.036164+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T16:45:04.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:04 smithi106 bash[13484]: cluster 2021-01-27T16:45:04.035052+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T16:45:04.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:04 smithi094 bash[9811]: audit 2021-01-27T16:45:03.035972+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:04.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:04 smithi094 bash[9811]: cluster 2021-01-27T16:45:03.036164+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-27T16:45:04.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:04 smithi094 bash[9811]: cluster 2021-01-27T16:45:04.035052+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-27T16:45:05.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:05 smithi106 bash[9795]: cluster 2021-01-27T16:45:03.553310+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v481: 212 pgs: 3 creating+peering, 14 unknown, 195 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:05.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:05 smithi106 bash[13484]: cluster 2021-01-27T16:45:03.553310+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v481: 212 pgs: 3 creating+peering, 14 unknown, 195 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:05.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:05 smithi094 bash[9811]: cluster 2021-01-27T16:45:03.553310+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v481: 212 pgs: 3 creating+peering, 14 unknown, 195 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:06.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:06 smithi106 bash[9795]: cluster 2021-01-27T16:45:05.062440+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T16:45:06.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:06 smithi106 bash[13484]: cluster 2021-01-27T16:45:05.062440+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T16:45:06.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:06 smithi094 bash[9811]: cluster 2021-01-27T16:45:05.062440+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-27T16:45:07.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: cluster 2021-01-27T16:45:05.554460+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v484: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:07.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: cluster 2021-01-27T16:45:06.064606+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T16:45:07.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: audit 2021-01-27T16:45:06.132894+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.106:0/3795533920' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: audit 2021-01-27T16:45:06.133389+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: audit 2021-01-27T16:45:07.069689+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:07.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[9795]: cluster 2021-01-27T16:45:07.069866+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T16:45:07.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: cluster 2021-01-27T16:45:05.554460+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v484: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:07.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: cluster 2021-01-27T16:45:06.064606+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T16:45:07.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: audit 2021-01-27T16:45:06.132894+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.106:0/3795533920' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.458 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: audit 2021-01-27T16:45:06.133389+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.459 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: audit 2021-01-27T16:45:07.069689+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:07.459 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:07 smithi106 bash[13484]: cluster 2021-01-27T16:45:07.069866+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T16:45:07.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: cluster 2021-01-27T16:45:05.554460+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v484: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 150 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:07.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: cluster 2021-01-27T16:45:06.064606+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-27T16:45:07.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: audit 2021-01-27T16:45:06.132894+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.106:0/3795533920' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: audit 2021-01-27T16:45:06.133389+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:07.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: audit 2021-01-27T16:45:07.069689+0000 mon.a (mon.0) 860 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:07.539 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:07 smithi094 bash[9811]: cluster 2021-01-27T16:45:07.069866+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-27T16:45:08.074 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_aio_writesame ... ok 2021-01-27T16:45:09.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:09 smithi106 bash[9795]: cluster 2021-01-27T16:45:07.555655+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v487: 212 pgs: 9 creating+peering, 8 unknown, 195 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:45:09.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:09 smithi106 bash[9795]: cluster 2021-01-27T16:45:08.068450+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T16:45:09.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:09 smithi106 bash[13484]: cluster 2021-01-27T16:45:07.555655+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v487: 212 pgs: 9 creating+peering, 8 unknown, 195 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:45:09.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:09 smithi106 bash[13484]: cluster 2021-01-27T16:45:08.068450+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T16:45:09.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:09 smithi094 bash[9811]: cluster 2021-01-27T16:45:07.555655+0000 mgr.y (mgr.14138) 550 : cluster [DBG] pgmap v487: 212 pgs: 9 creating+peering, 8 unknown, 195 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:45:09.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:09 smithi094 bash[9811]: cluster 2021-01-27T16:45:08.068450+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-27T16:45:10.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[9795]: cluster 2021-01-27T16:45:09.081377+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T16:45:10.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[9795]: audit 2021-01-27T16:45:09.086568+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:10.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[9795]: audit 2021-01-27T16:45:09.087746+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.106:0/2259568726' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:10.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[13484]: cluster 2021-01-27T16:45:09.081377+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T16:45:10.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[13484]: audit 2021-01-27T16:45:09.086568+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:10.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:10 smithi106 bash[13484]: audit 2021-01-27T16:45:09.087746+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.106:0/2259568726' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:10.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:10 smithi094 bash[9811]: cluster 2021-01-27T16:45:09.081377+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-27T16:45:10.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:10 smithi094 bash[9811]: audit 2021-01-27T16:45:09.086568+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:10.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:10 smithi094 bash[9811]: audit 2021-01-27T16:45:09.087746+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.106:0/2259568726' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:11.096 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_alignment ... ok 2021-01-27T16:45:11.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[9795]: cluster 2021-01-27T16:45:09.556580+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:11.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[9795]: audit 2021-01-27T16:45:10.092343+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:11.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[9795]: cluster 2021-01-27T16:45:10.093205+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T16:45:11.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[9795]: cluster 2021-01-27T16:45:11.087851+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T16:45:11.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[13484]: cluster 2021-01-27T16:45:09.556580+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:11.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[13484]: audit 2021-01-27T16:45:10.092343+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:11.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[13484]: cluster 2021-01-27T16:45:10.093205+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T16:45:11.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[13484]: cluster 2021-01-27T16:45:11.087851+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T16:45:11.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:11 smithi094 bash[9811]: cluster 2021-01-27T16:45:09.556580+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v490: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:11.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:11 smithi094 bash[9811]: audit 2021-01-27T16:45:10.092343+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:11.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:11 smithi094 bash[9811]: cluster 2021-01-27T16:45:10.093205+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-27T16:45:11.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:11 smithi094 bash[9811]: cluster 2021-01-27T16:45:11.087851+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-27T16:45:12.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:11 smithi106 bash[10032]: debug 2021-01-27T16:45:11.847+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:12.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:13.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[9795]: cluster 2021-01-27T16:45:11.557405+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v493: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:13.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[9795]: audit 2021-01-27T16:45:11.847579+0000 mgr.y (mgr.14138) 553 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:13.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[9795]: cluster 2021-01-27T16:45:12.117768+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T16:45:13.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[13484]: cluster 2021-01-27T16:45:11.557405+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v493: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:13.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[13484]: audit 2021-01-27T16:45:11.847579+0000 mgr.y (mgr.14138) 553 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:13.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:13 smithi106 bash[13484]: cluster 2021-01-27T16:45:12.117768+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T16:45:13.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:13 smithi094 bash[9811]: cluster 2021-01-27T16:45:11.557405+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v493: 180 pgs: 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:13.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:13 smithi094 bash[9811]: audit 2021-01-27T16:45:11.847579+0000 mgr.y (mgr.14138) 553 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:13.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:13 smithi094 bash[9811]: cluster 2021-01-27T16:45:12.117768+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-27T16:45:14.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[9795]: cluster 2021-01-27T16:45:13.122904+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T16:45:14.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[9795]: audit 2021-01-27T16:45:13.165319+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:14.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[9795]: audit 2021-01-27T16:45:13.166736+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.106:0/3504545400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:14.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[13484]: cluster 2021-01-27T16:45:13.122904+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T16:45:14.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[13484]: audit 2021-01-27T16:45:13.165319+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:14.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:14 smithi106 bash[13484]: audit 2021-01-27T16:45:13.166736+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.106:0/3504545400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:14.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:14 smithi094 bash[9811]: cluster 2021-01-27T16:45:13.122904+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-27T16:45:14.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:14 smithi094 bash[9811]: audit 2021-01-27T16:45:13.165319+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:14.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:14 smithi094 bash[9811]: audit 2021-01-27T16:45:13.166736+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.106:0/3504545400' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:15.162 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_append ... ok 2021-01-27T16:45:15.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[9795]: cluster 2021-01-27T16:45:13.558518+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v496: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:45:15.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[9795]: cluster 2021-01-27T16:45:14.131303+0000 mon.a (mon.0) 871 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:45:15.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[9795]: audit 2021-01-27T16:45:14.152217+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:15.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[9795]: cluster 2021-01-27T16:45:14.152329+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T16:45:15.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[13484]: cluster 2021-01-27T16:45:13.558518+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v496: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:45:15.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[13484]: cluster 2021-01-27T16:45:14.131303+0000 mon.a (mon.0) 871 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:45:15.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[13484]: audit 2021-01-27T16:45:14.152217+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:15.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:15 smithi106 bash[13484]: cluster 2021-01-27T16:45:14.152329+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T16:45:15.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:15 smithi094 bash[9811]: cluster 2021-01-27T16:45:13.558518+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v496: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:45:15.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:15 smithi094 bash[9811]: cluster 2021-01-27T16:45:14.131303+0000 mon.a (mon.0) 871 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:45:15.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:15 smithi094 bash[9811]: audit 2021-01-27T16:45:14.152217+0000 mon.a (mon.0) 872 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:15.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:15 smithi094 bash[9811]: cluster 2021-01-27T16:45:14.152329+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-27T16:45:16.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:16 smithi106 bash[9795]: cluster 2021-01-27T16:45:15.149887+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T16:45:16.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:16 smithi106 bash[13484]: cluster 2021-01-27T16:45:15.149887+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T16:45:16.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:16 smithi094 bash[9811]: cluster 2021-01-27T16:45:15.149887+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-27T16:45:17.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: cluster 2021-01-27T16:45:15.559438+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v499: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:17.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: cluster 2021-01-27T16:45:16.146072+0000 mon.a (mon.0) 875 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:45:17.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: cluster 2021-01-27T16:45:16.146163+0000 mon.a (mon.0) 876 : cluster [INF] Cluster is now healthy 2021-01-27T16:45:17.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: cluster 2021-01-27T16:45:16.163243+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T16:45:17.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: audit 2021-01-27T16:45:16.173685+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:45:17.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: audit 2021-01-27T16:45:16.176321+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:17.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[9795]: audit 2021-01-27T16:45:16.177133+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:17.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: cluster 2021-01-27T16:45:15.559438+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v499: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:17.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: cluster 2021-01-27T16:45:16.146072+0000 mon.a (mon.0) 875 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:45:17.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: cluster 2021-01-27T16:45:16.146163+0000 mon.a (mon.0) 876 : cluster [INF] Cluster is now healthy 2021-01-27T16:45:17.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: cluster 2021-01-27T16:45:16.163243+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T16:45:17.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: audit 2021-01-27T16:45:16.173685+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:45:17.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: audit 2021-01-27T16:45:16.176321+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:17.457 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:17 smithi106 bash[13484]: audit 2021-01-27T16:45:16.177133+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:17.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: cluster 2021-01-27T16:45:15.559438+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v499: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:17.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: cluster 2021-01-27T16:45:16.146072+0000 mon.a (mon.0) 875 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:45:17.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: cluster 2021-01-27T16:45:16.146163+0000 mon.a (mon.0) 876 : cluster [INF] Cluster is now healthy 2021-01-27T16:45:17.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: cluster 2021-01-27T16:45:16.163243+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-27T16:45:17.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: audit 2021-01-27T16:45:16.173685+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-27T16:45:17.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: audit 2021-01-27T16:45:16.176321+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:17.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:17 smithi094 bash[9811]: audit 2021-01-27T16:45:16.177133+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-27T16:45:18.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[9795]: audit 2021-01-27T16:45:17.167213+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T16:45:18.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[9795]: cluster 2021-01-27T16:45:17.167463+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T16:45:18.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[9795]: audit 2021-01-27T16:45:17.172489+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T16:45:18.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[9795]: audit 2021-01-27T16:45:17.182852+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:18.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[9795]: audit 2021-01-27T16:45:17.185601+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:18.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[13484]: audit 2021-01-27T16:45:17.167213+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T16:45:18.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[13484]: cluster 2021-01-27T16:45:17.167463+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T16:45:18.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[13484]: audit 2021-01-27T16:45:17.172489+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T16:45:18.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[13484]: audit 2021-01-27T16:45:17.182852+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:18.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:18 smithi106 bash[13484]: audit 2021-01-27T16:45:17.185601+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:18.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:18 smithi094 bash[9811]: audit 2021-01-27T16:45:17.167213+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-27T16:45:18.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:18 smithi094 bash[9811]: cluster 2021-01-27T16:45:17.167463+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-27T16:45:18.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:18 smithi094 bash[9811]: audit 2021-01-27T16:45:17.172489+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-27T16:45:18.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:18 smithi094 bash[9811]: audit 2021-01-27T16:45:17.182852+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:18.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:18 smithi094 bash[9811]: audit 2021-01-27T16:45:17.185601+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-27T16:45:19.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: cluster 2021-01-27T16:45:17.560369+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v502: 212 pgs: 6 creating+peering, 23 unknown, 183 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:19.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: audit 2021-01-27T16:45:18.184868+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T16:45:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: cluster 2021-01-27T16:45:18.185122+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T16:45:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: audit 2021-01-27T16:45:18.196552+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T16:45:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: audit 2021-01-27T16:45:18.197112+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[13484]: audit 2021-01-27T16:45:18.197645+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:19.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: cluster 2021-01-27T16:45:17.560369+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v502: 212 pgs: 6 creating+peering, 23 unknown, 183 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:19.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: audit 2021-01-27T16:45:18.184868+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T16:45:19.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: cluster 2021-01-27T16:45:18.185122+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T16:45:19.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: audit 2021-01-27T16:45:18.196552+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T16:45:19.456 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: audit 2021-01-27T16:45:18.197112+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:19.457 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:19 smithi106 bash[9795]: audit 2021-01-27T16:45:18.197645+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: cluster 2021-01-27T16:45:17.560369+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v502: 212 pgs: 6 creating+peering, 23 unknown, 183 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:45:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: audit 2021-01-27T16:45:18.184868+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-27T16:45:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: cluster 2021-01-27T16:45:18.185122+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-27T16:45:19.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: audit 2021-01-27T16:45:18.196552+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-27T16:45:19.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: audit 2021-01-27T16:45:18.197112+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:19.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:19 smithi094 bash[9811]: audit 2021-01-27T16:45:18.197645+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:20.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:20 smithi094 bash[9811]: audit 2021-01-27T16:45:19.198267+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:20.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:20 smithi094 bash[9811]: cluster 2021-01-27T16:45:19.198497+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T16:45:20.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:20 smithi094 bash[9811]: audit 2021-01-27T16:45:19.207262+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:20.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:20 smithi094 bash[9811]: audit 2021-01-27T16:45:19.207758+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:20.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[9795]: audit 2021-01-27T16:45:19.198267+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:20.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[9795]: cluster 2021-01-27T16:45:19.198497+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T16:45:20.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[9795]: audit 2021-01-27T16:45:19.207262+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:20.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[9795]: audit 2021-01-27T16:45:19.207758+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:20.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[13484]: audit 2021-01-27T16:45:19.198267+0000 mon.a (mon.0) 885 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:20.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[13484]: cluster 2021-01-27T16:45:19.198497+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-27T16:45:20.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[13484]: audit 2021-01-27T16:45:19.207262+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:20.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:20 smithi106 bash[13484]: audit 2021-01-27T16:45:19.207758+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-27T16:45:21.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[9811]: cluster 2021-01-27T16:45:19.561261+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v505: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:21.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[9811]: audit 2021-01-27T16:45:20.211461+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T16:45:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[9811]: cluster 2021-01-27T16:45:20.211677+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T16:45:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[9811]: audit 2021-01-27T16:45:20.215735+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:21.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[9811]: audit 2021-01-27T16:45:20.221514+0000 mon.a (mon.0) 890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:21.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[13484]: cluster 2021-01-27T16:45:19.561261+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v505: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:21.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[13484]: audit 2021-01-27T16:45:20.211461+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T16:45:21.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[13484]: cluster 2021-01-27T16:45:20.211677+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T16:45:21.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[13484]: audit 2021-01-27T16:45:20.215735+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:21.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[13484]: audit 2021-01-27T16:45:20.221514+0000 mon.a (mon.0) 890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:21.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[9795]: cluster 2021-01-27T16:45:19.561261+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v505: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:21.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[9795]: audit 2021-01-27T16:45:20.211461+0000 mon.a (mon.0) 888 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-27T16:45:21.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[9795]: cluster 2021-01-27T16:45:20.211677+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-27T16:45:21.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[9795]: audit 2021-01-27T16:45:20.215735+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:21.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[9795]: audit 2021-01-27T16:45:20.221514+0000 mon.a (mon.0) 890 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-27T16:45:22.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:21 smithi106 bash[10032]: debug 2021-01-27T16:45:21.851+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:22.246 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:22.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:22 smithi094 bash[9811]: audit 2021-01-27T16:45:21.235301+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:22.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:22 smithi094 bash[9811]: cluster 2021-01-27T16:45:21.235501+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T16:45:22.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:22 smithi094 bash[9811]: audit 2021-01-27T16:45:21.237579+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:22.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:22 smithi094 bash[9811]: audit 2021-01-27T16:45:21.238139+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:22.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[9795]: audit 2021-01-27T16:45:21.235301+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:22.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[9795]: cluster 2021-01-27T16:45:21.235501+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T16:45:22.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[9795]: audit 2021-01-27T16:45:21.237579+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:22.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[9795]: audit 2021-01-27T16:45:21.238139+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:22.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[13484]: audit 2021-01-27T16:45:21.235301+0000 mon.a (mon.0) 891 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-27T16:45:22.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[13484]: cluster 2021-01-27T16:45:21.235501+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-27T16:45:22.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[13484]: audit 2021-01-27T16:45:21.237579+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:22.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:22 smithi106 bash[13484]: audit 2021-01-27T16:45:21.238139+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-27T16:45:23.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: cluster 2021-01-27T16:45:21.562418+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v508: 212 pgs: 2 creating+peering, 210 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:23.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: audit 2021-01-27T16:45:21.853533+0000 mgr.y (mgr.14138) 559 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:23.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: audit 2021-01-27T16:45:22.237327+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T16:45:23.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: cluster 2021-01-27T16:45:22.237548+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T16:45:23.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: audit 2021-01-27T16:45:22.240282+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:23.538 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:23 smithi094 bash[9811]: audit 2021-01-27T16:45:22.250218+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:23.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: cluster 2021-01-27T16:45:21.562418+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v508: 212 pgs: 2 creating+peering, 210 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:23.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: audit 2021-01-27T16:45:21.853533+0000 mgr.y (mgr.14138) 559 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:23.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: audit 2021-01-27T16:45:22.237327+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T16:45:23.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: cluster 2021-01-27T16:45:22.237548+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T16:45:23.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: audit 2021-01-27T16:45:22.240282+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:23.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[9795]: audit 2021-01-27T16:45:22.250218+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:23.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: cluster 2021-01-27T16:45:21.562418+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v508: 212 pgs: 2 creating+peering, 210 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:23.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: audit 2021-01-27T16:45:21.853533+0000 mgr.y (mgr.14138) 559 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:23.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: audit 2021-01-27T16:45:22.237327+0000 mon.a (mon.0) 894 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-27T16:45:23.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: cluster 2021-01-27T16:45:22.237548+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-27T16:45:23.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: audit 2021-01-27T16:45:22.240282+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.106:0/1289530148' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:23.707 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:23 smithi106 bash[13484]: audit 2021-01-27T16:45:22.250218+0000 mon.a (mon.0) 896 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:24.271 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_applications ... ok 2021-01-27T16:45:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:24 smithi094 bash[9811]: audit 2021-01-27T16:45:23.263490+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:24.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:24 smithi094 bash[9811]: cluster 2021-01-27T16:45:23.263621+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T16:45:24.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:24 smithi106 bash[9795]: audit 2021-01-27T16:45:23.263490+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:24.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:24 smithi106 bash[9795]: cluster 2021-01-27T16:45:23.263621+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T16:45:24.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:24 smithi106 bash[13484]: audit 2021-01-27T16:45:23.263490+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:24.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:24 smithi106 bash[13484]: cluster 2021-01-27T16:45:23.263621+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-27T16:45:25.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:25 smithi094 bash[9811]: cluster 2021-01-27T16:45:23.563536+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v511: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:25.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:25 smithi094 bash[9811]: cluster 2021-01-27T16:45:24.267634+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T16:45:25.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:25 smithi106 bash[9795]: cluster 2021-01-27T16:45:23.563536+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v511: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:25.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:25 smithi106 bash[9795]: cluster 2021-01-27T16:45:24.267634+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T16:45:25.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:25 smithi106 bash[13484]: cluster 2021-01-27T16:45:23.563536+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v511: 212 pgs: 212 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:25.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:25 smithi106 bash[13484]: cluster 2021-01-27T16:45:24.267634+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-27T16:45:26.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:26 smithi106 bash[9795]: cluster 2021-01-27T16:45:25.289506+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T16:45:26.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:26 smithi106 bash[9795]: audit 2021-01-27T16:45:25.769942+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:45:26.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:26 smithi106 bash[13484]: cluster 2021-01-27T16:45:25.289506+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T16:45:26.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:26 smithi106 bash[13484]: audit 2021-01-27T16:45:25.769942+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:45:26.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:26 smithi094 bash[9811]: cluster 2021-01-27T16:45:25.289506+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-27T16:45:26.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:26 smithi094 bash[9811]: audit 2021-01-27T16:45:25.769942+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:45:27.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[9795]: cluster 2021-01-27T16:45:25.564532+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v514: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:27.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[9795]: cluster 2021-01-27T16:45:26.301440+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T16:45:27.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[9795]: audit 2021-01-27T16:45:26.332510+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.106:0/225813291' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:27.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[9795]: audit 2021-01-27T16:45:26.332976+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:27.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[13484]: cluster 2021-01-27T16:45:25.564532+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v514: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:27.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[13484]: cluster 2021-01-27T16:45:26.301440+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T16:45:27.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[13484]: audit 2021-01-27T16:45:26.332510+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.106:0/225813291' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:27.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:27 smithi106 bash[13484]: audit 2021-01-27T16:45:26.332976+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:27.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:27 smithi094 bash[9811]: cluster 2021-01-27T16:45:25.564532+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v514: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:27.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:27 smithi094 bash[9811]: cluster 2021-01-27T16:45:26.301440+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-27T16:45:27.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:27 smithi094 bash[9811]: audit 2021-01-27T16:45:26.332510+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.106:0/225813291' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:27.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:27 smithi094 bash[9811]: audit 2021-01-27T16:45:26.332976+0000 mon.a (mon.0) 903 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:28.330 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_clear_omap ... ok 2021-01-27T16:45:28.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:28 smithi106 bash[9795]: audit 2021-01-27T16:45:27.310421+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:28.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:28 smithi106 bash[9795]: cluster 2021-01-27T16:45:27.310508+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T16:45:28.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:28 smithi106 bash[13484]: audit 2021-01-27T16:45:27.310421+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:28.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:28 smithi106 bash[13484]: cluster 2021-01-27T16:45:27.310508+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T16:45:28.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:28 smithi094 bash[9811]: audit 2021-01-27T16:45:27.310421+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:28.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:28 smithi094 bash[9811]: cluster 2021-01-27T16:45:27.310508+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-27T16:45:29.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:29 smithi106 bash[9795]: cluster 2021-01-27T16:45:27.565521+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v517: 212 pgs: 6 creating+peering, 14 unknown, 192 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:29.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:29 smithi106 bash[9795]: cluster 2021-01-27T16:45:28.325116+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T16:45:29.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:29 smithi106 bash[13484]: cluster 2021-01-27T16:45:27.565521+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v517: 212 pgs: 6 creating+peering, 14 unknown, 192 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:29.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:29 smithi106 bash[13484]: cluster 2021-01-27T16:45:28.325116+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T16:45:29.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:29 smithi094 bash[9811]: cluster 2021-01-27T16:45:27.565521+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v517: 212 pgs: 6 creating+peering, 14 unknown, 192 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:29.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:29 smithi094 bash[9811]: cluster 2021-01-27T16:45:28.325116+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-27T16:45:30.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:30 smithi106 bash[9795]: cluster 2021-01-27T16:45:29.327133+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T16:45:30.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:30 smithi106 bash[13484]: cluster 2021-01-27T16:45:29.327133+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T16:45:30.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:30 smithi094 bash[9811]: cluster 2021-01-27T16:45:29.327133+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-27T16:45:31.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[13484]: cluster 2021-01-27T16:45:29.566447+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v520: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:31.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[13484]: cluster 2021-01-27T16:45:30.332029+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T16:45:31.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[13484]: audit 2021-01-27T16:45:30.370855+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.106:0/2911369958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:31.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[13484]: audit 2021-01-27T16:45:30.371190+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:31.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[9795]: cluster 2021-01-27T16:45:29.566447+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v520: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:31.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[9795]: cluster 2021-01-27T16:45:30.332029+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T16:45:31.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[9795]: audit 2021-01-27T16:45:30.370855+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.106:0/2911369958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:31.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[9795]: audit 2021-01-27T16:45:30.371190+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:31.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:31 smithi094 bash[9811]: cluster 2021-01-27T16:45:29.566447+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v520: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:31.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:31 smithi094 bash[9811]: cluster 2021-01-27T16:45:30.332029+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-27T16:45:31.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:31 smithi094 bash[9811]: audit 2021-01-27T16:45:30.370855+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.106:0/2911369958' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:31.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:31 smithi094 bash[9811]: audit 2021-01-27T16:45:30.371190+0000 mon.a (mon.0) 909 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:32.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:31 smithi106 bash[10032]: debug 2021-01-27T16:45:31.862+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:32.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:32.371 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_cmpext ... ok 2021-01-27T16:45:32.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:32 smithi106 bash[9795]: audit 2021-01-27T16:45:31.358917+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:32.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:32 smithi106 bash[9795]: cluster 2021-01-27T16:45:31.359132+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T16:45:32.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:32 smithi106 bash[13484]: audit 2021-01-27T16:45:31.358917+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:32.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:32 smithi106 bash[13484]: cluster 2021-01-27T16:45:31.359132+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T16:45:32.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:32 smithi094 bash[9811]: audit 2021-01-27T16:45:31.358917+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:32.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:32 smithi094 bash[9811]: cluster 2021-01-27T16:45:31.359132+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-27T16:45:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[9795]: cluster 2021-01-27T16:45:31.567555+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v523: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:33.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[9795]: audit 2021-01-27T16:45:31.864877+0000 mgr.y (mgr.14138) 565 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:33.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[9795]: cluster 2021-01-27T16:45:32.368145+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T16:45:33.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[9795]: audit 2021-01-27T16:45:32.830088+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:45:33.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[13484]: cluster 2021-01-27T16:45:31.567555+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v523: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:33.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[13484]: audit 2021-01-27T16:45:31.864877+0000 mgr.y (mgr.14138) 565 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:33.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[13484]: cluster 2021-01-27T16:45:32.368145+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T16:45:33.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:33 smithi106 bash[13484]: audit 2021-01-27T16:45:32.830088+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:45:33.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:33 smithi094 bash[9811]: cluster 2021-01-27T16:45:31.567555+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v523: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:33.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:33 smithi094 bash[9811]: audit 2021-01-27T16:45:31.864877+0000 mgr.y (mgr.14138) 565 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:33.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:33 smithi094 bash[9811]: cluster 2021-01-27T16:45:32.368145+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-27T16:45:33.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:33 smithi094 bash[9811]: audit 2021-01-27T16:45:32.830088+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:45:34.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:34 smithi106 bash[9795]: cluster 2021-01-27T16:45:33.370321+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T16:45:34.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:34 smithi106 bash[13484]: cluster 2021-01-27T16:45:33.370321+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T16:45:34.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:34 smithi094 bash[9811]: cluster 2021-01-27T16:45:33.370321+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-27T16:45:35.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[13484]: cluster 2021-01-27T16:45:33.568577+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v526: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:35.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[13484]: cluster 2021-01-27T16:45:34.384811+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T16:45:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[13484]: audit 2021-01-27T16:45:34.425153+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.106:0/3373723169' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:35.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[13484]: audit 2021-01-27T16:45:34.425475+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:35.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[9795]: cluster 2021-01-27T16:45:33.568577+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v526: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:35.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[9795]: cluster 2021-01-27T16:45:34.384811+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T16:45:35.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[9795]: audit 2021-01-27T16:45:34.425153+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.106:0/3373723169' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:35.706 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:35 smithi106 bash[9795]: audit 2021-01-27T16:45:34.425475+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:35.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:35 smithi094 bash[9811]: cluster 2021-01-27T16:45:33.568577+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v526: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:35.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:35 smithi094 bash[9811]: cluster 2021-01-27T16:45:34.384811+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-27T16:45:35.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:35 smithi094 bash[9811]: audit 2021-01-27T16:45:34.425153+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.106:0/3373723169' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:35.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:35 smithi094 bash[9811]: audit 2021-01-27T16:45:34.425475+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:36.423 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_cmpext_op ... ok 2021-01-27T16:45:36.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:36 smithi106 bash[9795]: audit 2021-01-27T16:45:35.406935+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:36.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:36 smithi106 bash[9795]: cluster 2021-01-27T16:45:35.407097+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T16:45:36.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:36 smithi106 bash[13484]: audit 2021-01-27T16:45:35.406935+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:36.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:36 smithi106 bash[13484]: cluster 2021-01-27T16:45:35.407097+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T16:45:36.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:36 smithi094 bash[9811]: audit 2021-01-27T16:45:35.406935+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:36.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:36 smithi094 bash[9811]: cluster 2021-01-27T16:45:35.407097+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-27T16:45:37.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:37 smithi106 bash[9795]: cluster 2021-01-27T16:45:35.569555+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v529: 212 pgs: 3 creating+peering, 18 unknown, 191 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:37.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:37 smithi106 bash[9795]: cluster 2021-01-27T16:45:36.416891+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T16:45:37.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:37 smithi106 bash[13484]: cluster 2021-01-27T16:45:35.569555+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v529: 212 pgs: 3 creating+peering, 18 unknown, 191 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:37.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:37 smithi106 bash[13484]: cluster 2021-01-27T16:45:36.416891+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T16:45:37.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:37 smithi094 bash[9811]: cluster 2021-01-27T16:45:35.569555+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v529: 212 pgs: 3 creating+peering, 18 unknown, 191 active+clean; 25 KiB data, 160 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:37.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:37 smithi094 bash[9811]: cluster 2021-01-27T16:45:36.416891+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-27T16:45:38.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:38 smithi106 bash[9795]: cluster 2021-01-27T16:45:37.431329+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T16:45:38.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:38 smithi106 bash[13484]: cluster 2021-01-27T16:45:37.431329+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T16:45:38.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:38 smithi094 bash[9811]: cluster 2021-01-27T16:45:37.431329+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-27T16:45:39.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:39 smithi106 bash[9795]: cluster 2021-01-27T16:45:37.570559+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v532: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:39.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:39 smithi106 bash[9795]: cluster 2021-01-27T16:45:38.440959+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T16:45:39.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:39 smithi106 bash[13484]: cluster 2021-01-27T16:45:37.570559+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v532: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:39.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:39 smithi106 bash[13484]: cluster 2021-01-27T16:45:38.440959+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T16:45:39.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:39 smithi094 bash[9811]: cluster 2021-01-27T16:45:37.570559+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v532: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 161 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:39.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:39 smithi094 bash[9811]: cluster 2021-01-27T16:45:38.440959+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-27T16:45:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:40 smithi094 bash[9811]: cluster 2021-01-27T16:45:39.442553+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T16:45:40.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:40 smithi094 bash[9811]: audit 2021-01-27T16:45:39.453240+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:40.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:40 smithi094 bash[9811]: audit 2021-01-27T16:45:39.454657+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.106:0/3642301170' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:40.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[9795]: cluster 2021-01-27T16:45:39.442553+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T16:45:40.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[9795]: audit 2021-01-27T16:45:39.453240+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:40.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[9795]: audit 2021-01-27T16:45:39.454657+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.106:0/3642301170' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:40.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[13484]: cluster 2021-01-27T16:45:39.442553+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-27T16:45:40.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[13484]: audit 2021-01-27T16:45:39.453240+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:40.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:40 smithi106 bash[13484]: audit 2021-01-27T16:45:39.454657+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.106:0/3642301170' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:41.462 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_create_snap ... ok 2021-01-27T16:45:41.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:41 smithi094 bash[9811]: cluster 2021-01-27T16:45:39.571552+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v535: 212 pgs: 9 creating+peering, 19 unknown, 184 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:41.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:41 smithi094 bash[9811]: audit 2021-01-27T16:45:40.454441+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:41.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:41 smithi094 bash[9811]: cluster 2021-01-27T16:45:40.454655+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T16:45:41.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:41 smithi094 bash[9811]: cluster 2021-01-27T16:45:41.457464+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T16:45:41.876 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[9795]: cluster 2021-01-27T16:45:39.571552+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v535: 212 pgs: 9 creating+peering, 19 unknown, 184 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:41.877 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[9795]: audit 2021-01-27T16:45:40.454441+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:41.877 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[9795]: cluster 2021-01-27T16:45:40.454655+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T16:45:41.877 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[9795]: cluster 2021-01-27T16:45:41.457464+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T16:45:41.877 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[13484]: cluster 2021-01-27T16:45:39.571552+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v535: 212 pgs: 9 creating+peering, 19 unknown, 184 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:41.877 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[13484]: audit 2021-01-27T16:45:40.454441+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:41.878 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[13484]: cluster 2021-01-27T16:45:40.454655+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-27T16:45:41.878 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[13484]: cluster 2021-01-27T16:45:41.457464+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-27T16:45:42.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:41 smithi106 bash[10032]: debug 2021-01-27T16:45:41.874+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:42.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:43.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:43 smithi094 bash[9811]: cluster 2021-01-27T16:45:41.572479+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:43.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:43 smithi094 bash[9811]: audit 2021-01-27T16:45:41.876072+0000 mgr.y (mgr.14138) 571 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:43.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:43 smithi094 bash[9811]: cluster 2021-01-27T16:45:42.482588+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T16:45:43.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[13484]: cluster 2021-01-27T16:45:41.572479+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:43.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[13484]: audit 2021-01-27T16:45:41.876072+0000 mgr.y (mgr.14138) 571 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:43.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[13484]: cluster 2021-01-27T16:45:42.482588+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T16:45:43.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[9795]: cluster 2021-01-27T16:45:41.572479+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v538: 180 pgs: 180 active+clean; 25 KiB data, 162 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:43.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[9795]: audit 2021-01-27T16:45:41.876072+0000 mgr.y (mgr.14138) 571 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:43.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:43 smithi106 bash[9795]: cluster 2021-01-27T16:45:42.482588+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-27T16:45:44.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:44 smithi094 bash[9811]: cluster 2021-01-27T16:45:43.482851+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T16:45:44.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:44 smithi094 bash[9811]: audit 2021-01-27T16:45:43.516270+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.106:0/26493885' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:44.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:44 smithi094 bash[9811]: audit 2021-01-27T16:45:43.516904+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:44.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[13484]: cluster 2021-01-27T16:45:43.482851+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T16:45:44.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[13484]: audit 2021-01-27T16:45:43.516270+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.106:0/26493885' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:44.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[13484]: audit 2021-01-27T16:45:43.516904+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:44.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[9795]: cluster 2021-01-27T16:45:43.482851+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-27T16:45:44.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[9795]: audit 2021-01-27T16:45:43.516270+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.106:0/26493885' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:44.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:44 smithi106 bash[9795]: audit 2021-01-27T16:45:43.516904+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:45.518 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_execute ... ok 2021-01-27T16:45:45.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:45 smithi094 bash[9811]: cluster 2021-01-27T16:45:43.573425+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:45.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:45 smithi094 bash[9811]: audit 2021-01-27T16:45:44.508230+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:45.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:45 smithi094 bash[9811]: cluster 2021-01-27T16:45:44.508410+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T16:45:45.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[9795]: cluster 2021-01-27T16:45:43.573425+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:45.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[9795]: audit 2021-01-27T16:45:44.508230+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:45.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[9795]: cluster 2021-01-27T16:45:44.508410+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T16:45:45.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[13484]: cluster 2021-01-27T16:45:43.573425+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v541: 212 pgs: 8 creating+peering, 18 unknown, 186 active+clean; 25 KiB data, 163 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:45.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[13484]: audit 2021-01-27T16:45:44.508230+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:45.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:45 smithi106 bash[13484]: cluster 2021-01-27T16:45:44.508410+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-27T16:45:46.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:46 smithi094 bash[9811]: cluster 2021-01-27T16:45:45.509121+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T16:45:46.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:46 smithi106 bash[9795]: cluster 2021-01-27T16:45:45.509121+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T16:45:46.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:46 smithi106 bash[13484]: cluster 2021-01-27T16:45:45.509121+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-27T16:45:47.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:47 smithi106 bash[13484]: cluster 2021-01-27T16:45:45.574193+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v544: 180 pgs: 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:47.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:47 smithi106 bash[13484]: cluster 2021-01-27T16:45:46.527757+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T16:45:47.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:47 smithi106 bash[9795]: cluster 2021-01-27T16:45:45.574193+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v544: 180 pgs: 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:47.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:47 smithi106 bash[9795]: cluster 2021-01-27T16:45:46.527757+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T16:45:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:47 smithi094 bash[9811]: cluster 2021-01-27T16:45:45.574193+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v544: 180 pgs: 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:48.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:47 smithi094 bash[9811]: cluster 2021-01-27T16:45:46.527757+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-27T16:45:48.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[9795]: cluster 2021-01-27T16:45:47.530760+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T16:45:48.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[9795]: audit 2021-01-27T16:45:47.564935+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.106:0/2285677724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:48.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[9795]: audit 2021-01-27T16:45:47.565295+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:48.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[9795]: cluster 2021-01-27T16:45:47.574741+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v547: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:48.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[13484]: cluster 2021-01-27T16:45:47.530760+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T16:45:48.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[13484]: audit 2021-01-27T16:45:47.564935+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.106:0/2285677724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:48.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[13484]: audit 2021-01-27T16:45:47.565295+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:48.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:48 smithi106 bash[13484]: cluster 2021-01-27T16:45:47.574741+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v547: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:49.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:48 smithi094 bash[9811]: cluster 2021-01-27T16:45:47.530760+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-27T16:45:49.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:48 smithi094 bash[9811]: audit 2021-01-27T16:45:47.564935+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.106:0/2285677724' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:49.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:48 smithi094 bash[9811]: audit 2021-01-27T16:45:47.565295+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:49.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:48 smithi094 bash[9811]: cluster 2021-01-27T16:45:47.574741+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v547: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 168 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:49.561 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_execute_op ... ok 2021-01-27T16:45:49.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:49 smithi106 bash[9795]: audit 2021-01-27T16:45:48.556230+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:49.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:49 smithi106 bash[9795]: cluster 2021-01-27T16:45:48.556293+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T16:45:49.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:49 smithi106 bash[13484]: audit 2021-01-27T16:45:48.556230+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:49.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:49 smithi106 bash[13484]: cluster 2021-01-27T16:45:48.556293+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T16:45:50.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:49 smithi094 bash[9811]: audit 2021-01-27T16:45:48.556230+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:50.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:49 smithi094 bash[9811]: cluster 2021-01-27T16:45:48.556293+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-27T16:45:50.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:50 smithi106 bash[9795]: cluster 2021-01-27T16:45:49.556652+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T16:45:51.088 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:50 smithi106 bash[9795]: cluster 2021-01-27T16:45:49.575286+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v550: 180 pgs: 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:51.088 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:50 smithi106 bash[13484]: cluster 2021-01-27T16:45:49.556652+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T16:45:51.088 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:50 smithi106 bash[13484]: cluster 2021-01-27T16:45:49.575286+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v550: 180 pgs: 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:51.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:50 smithi094 bash[9811]: cluster 2021-01-27T16:45:49.556652+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-27T16:45:51.089 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:50 smithi094 bash[9811]: cluster 2021-01-27T16:45:49.575286+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v550: 180 pgs: 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:45:51.885 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[13484]: cluster 2021-01-27T16:45:50.581445+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T16:45:51.886 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[13484]: audit 2021-01-27T16:45:50.589416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.106:0/1266699370' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:51.886 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[13484]: audit 2021-01-27T16:45:50.590380+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:51.886 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[9795]: cluster 2021-01-27T16:45:50.581445+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T16:45:51.887 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[9795]: audit 2021-01-27T16:45:50.589416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.106:0/1266699370' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:51.887 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[9795]: audit 2021-01-27T16:45:50.590380+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:51.887 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:51 smithi094 bash[9811]: cluster 2021-01-27T16:45:50.581445+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-27T16:45:51.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:51 smithi094 bash[9811]: audit 2021-01-27T16:45:50.589416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.106:0/1266699370' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:51.888 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:51 smithi094 bash[9811]: audit 2021-01-27T16:45:50.590380+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:52.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:45:51 smithi106 bash[10032]: debug 2021-01-27T16:45:51.882+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:45:52.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:45:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:45:52.612 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_last_version ... ok 2021-01-27T16:45:52.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[9795]: cluster 2021-01-27T16:45:51.576470+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v552: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:52.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[9795]: audit 2021-01-27T16:45:51.585747+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:52.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[9795]: cluster 2021-01-27T16:45:51.585920+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T16:45:52.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[9795]: audit 2021-01-27T16:45:51.884921+0000 mgr.y (mgr.14138) 577 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:52.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[13484]: cluster 2021-01-27T16:45:51.576470+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v552: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:52.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[13484]: audit 2021-01-27T16:45:51.585747+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:52.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[13484]: cluster 2021-01-27T16:45:51.585920+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T16:45:52.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:52 smithi106 bash[13484]: audit 2021-01-27T16:45:51.884921+0000 mgr.y (mgr.14138) 577 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:53.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:52 smithi094 bash[9811]: cluster 2021-01-27T16:45:51.576470+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v552: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:53.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:52 smithi094 bash[9811]: audit 2021-01-27T16:45:51.585747+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:53.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:52 smithi094 bash[9811]: cluster 2021-01-27T16:45:51.585920+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-27T16:45:53.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:52 smithi094 bash[9811]: audit 2021-01-27T16:45:51.884921+0000 mgr.y (mgr.14138) 577 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:45:53.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:53 smithi106 bash[9795]: cluster 2021-01-27T16:45:52.608065+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T16:45:53.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:53 smithi106 bash[13484]: cluster 2021-01-27T16:45:52.608065+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T16:45:54.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:53 smithi094 bash[9811]: cluster 2021-01-27T16:45:52.608065+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-27T16:45:54.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:54 smithi106 bash[9795]: cluster 2021-01-27T16:45:53.577549+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:54.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:54 smithi106 bash[9795]: cluster 2021-01-27T16:45:53.617746+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T16:45:54.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:54 smithi106 bash[13484]: cluster 2021-01-27T16:45:53.577549+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:54.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:54 smithi106 bash[13484]: cluster 2021-01-27T16:45:53.617746+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T16:45:55.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:54 smithi094 bash[9811]: cluster 2021-01-27T16:45:53.577549+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 182 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:55.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:54 smithi094 bash[9811]: cluster 2021-01-27T16:45:53.617746+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-27T16:45:55.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[13484]: cluster 2021-01-27T16:45:54.626396+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T16:45:55.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[13484]: audit 2021-01-27T16:45:54.659331+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.106:0/1814173484' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:55.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[13484]: audit 2021-01-27T16:45:54.660006+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:55.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[9795]: cluster 2021-01-27T16:45:54.626396+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T16:45:55.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[9795]: audit 2021-01-27T16:45:54.659331+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.106:0/1814173484' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:55.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:55 smithi106 bash[9795]: audit 2021-01-27T16:45:54.660006+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:56.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:55 smithi094 bash[9811]: cluster 2021-01-27T16:45:54.626396+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-27T16:45:56.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:55 smithi094 bash[9811]: audit 2021-01-27T16:45:54.659331+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.106:0/1814173484' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:56.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:55 smithi094 bash[9811]: audit 2021-01-27T16:45:54.660006+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:56.659 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_omap_keys ... ok 2021-01-27T16:45:56.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[9795]: cluster 2021-01-27T16:45:55.578664+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v558: 212 pgs: 3 creating+peering, 24 unknown, 185 active+clean; 25 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:56.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[9795]: audit 2021-01-27T16:45:55.650684+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:56.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[9795]: cluster 2021-01-27T16:45:55.650801+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T16:45:56.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[13484]: cluster 2021-01-27T16:45:55.578664+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v558: 212 pgs: 3 creating+peering, 24 unknown, 185 active+clean; 25 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:56.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[13484]: audit 2021-01-27T16:45:55.650684+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:56.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:56 smithi106 bash[13484]: cluster 2021-01-27T16:45:55.650801+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T16:45:57.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:56 smithi094 bash[9811]: cluster 2021-01-27T16:45:55.578664+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v558: 212 pgs: 3 creating+peering, 24 unknown, 185 active+clean; 25 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:57.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:56 smithi094 bash[9811]: audit 2021-01-27T16:45:55.650684+0000 mon.a (mon.0) 947 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:45:57.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:56 smithi094 bash[9811]: cluster 2021-01-27T16:45:55.650801+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-27T16:45:57.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:57 smithi106 bash[9795]: cluster 2021-01-27T16:45:56.654711+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T16:45:57.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:57 smithi106 bash[13484]: cluster 2021-01-27T16:45:56.654711+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T16:45:58.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:57 smithi094 bash[9811]: cluster 2021-01-27T16:45:56.654711+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-27T16:45:58.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:58 smithi106 bash[9795]: cluster 2021-01-27T16:45:57.579743+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v561: 180 pgs: 180 active+clean; 25 KiB data, 184 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:58.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:58 smithi106 bash[9795]: cluster 2021-01-27T16:45:57.675997+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T16:45:58.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:58 smithi106 bash[13484]: cluster 2021-01-27T16:45:57.579743+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v561: 180 pgs: 180 active+clean; 25 KiB data, 184 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:58.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:58 smithi106 bash[13484]: cluster 2021-01-27T16:45:57.675997+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T16:45:59.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:58 smithi094 bash[9811]: cluster 2021-01-27T16:45:57.579743+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v561: 180 pgs: 180 active+clean; 25 KiB data, 184 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:45:59.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:58 smithi094 bash[9811]: cluster 2021-01-27T16:45:57.675997+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-27T16:45:59.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:59 smithi106 bash[9795]: cluster 2021-01-27T16:45:58.681540+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T16:45:59.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:45:59 smithi106 bash[9795]: audit 2021-01-27T16:45:58.718655+0000 mon.a (mon.0) 952 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:45:59.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:59 smithi106 bash[13484]: cluster 2021-01-27T16:45:58.681540+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T16:45:59.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:45:59 smithi106 bash[13484]: audit 2021-01-27T16:45:58.718655+0000 mon.a (mon.0) 952 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:00.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:59 smithi094 bash[9811]: cluster 2021-01-27T16:45:58.681540+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-27T16:46:00.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:45:59 smithi094 bash[9811]: audit 2021-01-27T16:45:58.718655+0000 mon.a (mon.0) 952 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:00.717 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_omap_vals_by_keys ... ok 2021-01-27T16:46:01.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:00 smithi094 bash[9811]: cluster 2021-01-27T16:45:59.580678+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v564: 212 pgs: 3 creating+peering, 26 unknown, 183 active+clean; 25 KiB data, 185 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:01.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:00 smithi094 bash[9811]: audit 2021-01-27T16:45:59.707360+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:01.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:00 smithi094 bash[9811]: cluster 2021-01-27T16:45:59.707447+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T16:46:01.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[9795]: cluster 2021-01-27T16:45:59.580678+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v564: 212 pgs: 3 creating+peering, 26 unknown, 183 active+clean; 25 KiB data, 185 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:01.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[9795]: audit 2021-01-27T16:45:59.707360+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:01.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[9795]: cluster 2021-01-27T16:45:59.707447+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T16:46:01.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[13484]: cluster 2021-01-27T16:45:59.580678+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v564: 212 pgs: 3 creating+peering, 26 unknown, 183 active+clean; 25 KiB data, 185 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:01.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[13484]: audit 2021-01-27T16:45:59.707360+0000 mon.a (mon.0) 953 : audit [INF] from='client.? 172.21.15.106:0/2969327817' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:01.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:00 smithi106 bash[13484]: cluster 2021-01-27T16:45:59.707447+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-27T16:46:02.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:01 smithi094 bash[9811]: cluster 2021-01-27T16:46:00.713225+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T16:46:02.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:02.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:01 smithi106 bash[10032]: debug 2021-01-27T16:46:01.886+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:02.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:01 smithi106 bash[13484]: cluster 2021-01-27T16:46:00.713225+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T16:46:02.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:01 smithi106 bash[9795]: cluster 2021-01-27T16:46:00.713225+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-27T16:46:03.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: cluster 2021-01-27T16:46:01.581685+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v567: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:03.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: cluster 2021-01-27T16:46:01.731706+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T16:46:03.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: audit 2021-01-27T16:46:01.733213+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.106:0/3621207517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: audit 2021-01-27T16:46:01.736771+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: audit 2021-01-27T16:46:01.889024+0000 mgr.y (mgr.14138) 583 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:03.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: audit 2021-01-27T16:46:02.731826+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:03.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:02 smithi094 bash[9811]: cluster 2021-01-27T16:46:02.732251+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T16:46:03.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: cluster 2021-01-27T16:46:01.581685+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v567: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:03.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: cluster 2021-01-27T16:46:01.731706+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T16:46:03.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: audit 2021-01-27T16:46:01.733213+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.106:0/3621207517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: audit 2021-01-27T16:46:01.736771+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: audit 2021-01-27T16:46:01.889024+0000 mgr.y (mgr.14138) 583 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:03.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: audit 2021-01-27T16:46:02.731826+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:03.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[9795]: cluster 2021-01-27T16:46:02.732251+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T16:46:03.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: cluster 2021-01-27T16:46:01.581685+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v567: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:03.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: cluster 2021-01-27T16:46:01.731706+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-27T16:46:03.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: audit 2021-01-27T16:46:01.733213+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.106:0/3621207517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: audit 2021-01-27T16:46:01.736771+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:03.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: audit 2021-01-27T16:46:01.889024+0000 mgr.y (mgr.14138) 583 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:03.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: audit 2021-01-27T16:46:02.731826+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:03.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:02 smithi106 bash[13484]: cluster 2021-01-27T16:46:02.732251+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-27T16:46:03.739 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_pool_id ... ok 2021-01-27T16:46:05.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:04 smithi094 bash[9811]: cluster 2021-01-27T16:46:03.582744+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v570: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:05.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:04 smithi094 bash[9811]: cluster 2021-01-27T16:46:03.735350+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T16:46:05.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:04 smithi106 bash[9795]: cluster 2021-01-27T16:46:03.582744+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v570: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:05.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:04 smithi106 bash[9795]: cluster 2021-01-27T16:46:03.735350+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T16:46:05.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:04 smithi106 bash[13484]: cluster 2021-01-27T16:46:03.582744+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v570: 212 pgs: 13 creating+peering, 14 unknown, 185 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:05.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:04 smithi106 bash[13484]: cluster 2021-01-27T16:46:03.735350+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-27T16:46:06.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:05 smithi094 bash[9811]: cluster 2021-01-27T16:46:04.762064+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T16:46:06.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:05 smithi094 bash[9811]: audit 2021-01-27T16:46:04.767005+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:06.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:05 smithi106 bash[9795]: cluster 2021-01-27T16:46:04.762064+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T16:46:06.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:05 smithi106 bash[9795]: audit 2021-01-27T16:46:04.767005+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:06.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:05 smithi106 bash[13484]: cluster 2021-01-27T16:46:04.762064+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-27T16:46:06.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:05 smithi106 bash[13484]: audit 2021-01-27T16:46:04.767005+0000 mon.a (mon.0) 962 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:06.781 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_pool_name ... ok 2021-01-27T16:46:07.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:06 smithi094 bash[9811]: cluster 2021-01-27T16:46:05.583972+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v573: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:07.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:06 smithi094 bash[9811]: audit 2021-01-27T16:46:05.771222+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:07.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:06 smithi094 bash[9811]: cluster 2021-01-27T16:46:05.771696+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T16:46:07.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[9795]: cluster 2021-01-27T16:46:05.583972+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v573: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:07.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[9795]: audit 2021-01-27T16:46:05.771222+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:07.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[9795]: cluster 2021-01-27T16:46:05.771696+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T16:46:07.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[13484]: cluster 2021-01-27T16:46:05.583972+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v573: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:07.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[13484]: audit 2021-01-27T16:46:05.771222+0000 mon.a (mon.0) 963 : audit [INF] from='client.? 172.21.15.106:0/4111937480' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:07.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:06 smithi106 bash[13484]: cluster 2021-01-27T16:46:05.771696+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-27T16:46:08.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:07 smithi106 bash[9795]: cluster 2021-01-27T16:46:06.775867+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T16:46:08.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:07 smithi106 bash[13484]: cluster 2021-01-27T16:46:06.775867+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T16:46:08.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:07 smithi094 bash[9811]: cluster 2021-01-27T16:46:06.775867+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-27T16:46:09.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[13484]: cluster 2021-01-27T16:46:07.585100+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:09.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[13484]: cluster 2021-01-27T16:46:07.802262+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T16:46:09.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[13484]: audit 2021-01-27T16:46:07.805308+0000 mon.a (mon.0) 967 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:09.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[9795]: cluster 2021-01-27T16:46:07.585100+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:09.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[9795]: cluster 2021-01-27T16:46:07.802262+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T16:46:09.206 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:08 smithi106 bash[9795]: audit 2021-01-27T16:46:07.805308+0000 mon.a (mon.0) 967 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:09.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:08 smithi094 bash[9811]: cluster 2021-01-27T16:46:07.585100+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 196 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:09.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:08 smithi094 bash[9811]: cluster 2021-01-27T16:46:07.802262+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-27T16:46:09.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:08 smithi094 bash[9811]: audit 2021-01-27T16:46:07.805308+0000 mon.a (mon.0) 967 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:09.815 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_get_stats ... ok 2021-01-27T16:46:10.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[9795]: audit 2021-01-27T16:46:08.803814+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:10.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[9795]: cluster 2021-01-27T16:46:08.804242+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T16:46:10.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[9795]: cluster 2021-01-27T16:46:09.806860+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T16:46:10.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[13484]: audit 2021-01-27T16:46:08.803814+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:10.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[13484]: cluster 2021-01-27T16:46:08.804242+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T16:46:10.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:09 smithi106 bash[13484]: cluster 2021-01-27T16:46:09.806860+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T16:46:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:09 smithi094 bash[9811]: audit 2021-01-27T16:46:08.803814+0000 mon.a (mon.0) 968 : audit [INF] from='client.? 172.21.15.106:0/2897881651' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:10.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:09 smithi094 bash[9811]: cluster 2021-01-27T16:46:08.804242+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-27T16:46:10.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:09 smithi094 bash[9811]: cluster 2021-01-27T16:46:09.806860+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-27T16:46:11.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:10 smithi106 bash[13484]: cluster 2021-01-27T16:46:09.586016+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v579: 212 pgs: 4 creating+peering, 26 unknown, 182 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:11.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:10 smithi106 bash[9795]: cluster 2021-01-27T16:46:09.586016+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v579: 212 pgs: 4 creating+peering, 26 unknown, 182 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:11.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:10 smithi094 bash[9811]: cluster 2021-01-27T16:46:09.586016+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v579: 212 pgs: 4 creating+peering, 26 unknown, 182 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:12.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:11 smithi106 bash[9795]: cluster 2021-01-27T16:46:10.838120+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T16:46:12.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:11 smithi106 bash[10032]: debug 2021-01-27T16:46:11.893+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:12.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:11 smithi106 bash[13484]: cluster 2021-01-27T16:46:10.838120+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T16:46:12.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:12.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:11 smithi094 bash[9811]: cluster 2021-01-27T16:46:10.838120+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-27T16:46:13.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[9795]: cluster 2021-01-27T16:46:11.587225+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v582: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:13.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[9795]: cluster 2021-01-27T16:46:11.849319+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T16:46:13.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[9795]: audit 2021-01-27T16:46:11.896749+0000 mgr.y (mgr.14138) 589 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:13.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[9795]: audit 2021-01-27T16:46:11.931196+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:13.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[13484]: cluster 2021-01-27T16:46:11.587225+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v582: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:13.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[13484]: cluster 2021-01-27T16:46:11.849319+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T16:46:13.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[13484]: audit 2021-01-27T16:46:11.896749+0000 mgr.y (mgr.14138) 589 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:13.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:12 smithi106 bash[13484]: audit 2021-01-27T16:46:11.931196+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:13.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:12 smithi094 bash[9811]: cluster 2021-01-27T16:46:11.587225+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v582: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 197 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:13.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:12 smithi094 bash[9811]: cluster 2021-01-27T16:46:11.849319+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-27T16:46:13.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:12 smithi094 bash[9811]: audit 2021-01-27T16:46:11.896749+0000 mgr.y (mgr.14138) 589 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:13.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:12 smithi094 bash[9811]: audit 2021-01-27T16:46:11.931196+0000 mon.a (mon.0) 973 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:13.858 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_list_ns_objects ... ok 2021-01-27T16:46:14.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[9795]: audit 2021-01-27T16:46:12.851613+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:14.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[9795]: cluster 2021-01-27T16:46:12.851807+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T16:46:14.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[9795]: cluster 2021-01-27T16:46:13.853105+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T16:46:14.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[13484]: audit 2021-01-27T16:46:12.851613+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:14.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[13484]: cluster 2021-01-27T16:46:12.851807+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T16:46:14.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:13 smithi106 bash[13484]: cluster 2021-01-27T16:46:13.853105+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T16:46:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:13 smithi094 bash[9811]: audit 2021-01-27T16:46:12.851613+0000 mon.a (mon.0) 974 : audit [INF] from='client.? 172.21.15.106:0/3194204818' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:13 smithi094 bash[9811]: cluster 2021-01-27T16:46:12.851807+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-27T16:46:14.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:13 smithi094 bash[9811]: cluster 2021-01-27T16:46:13.853105+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-27T16:46:15.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:14 smithi106 bash[13484]: cluster 2021-01-27T16:46:13.588288+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v585: 212 pgs: 8 creating+peering, 8 unknown, 196 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:46:15.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:14 smithi106 bash[13484]: cluster 2021-01-27T16:46:13.856857+0000 mon.a (mon.0) 977 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:15.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:14 smithi106 bash[9795]: cluster 2021-01-27T16:46:13.588288+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v585: 212 pgs: 8 creating+peering, 8 unknown, 196 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:46:15.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:14 smithi106 bash[9795]: cluster 2021-01-27T16:46:13.856857+0000 mon.a (mon.0) 977 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:15.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:14 smithi094 bash[9811]: cluster 2021-01-27T16:46:13.588288+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v585: 212 pgs: 8 creating+peering, 8 unknown, 196 active+clean; 25 KiB data, 203 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-27T16:46:15.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:14 smithi094 bash[9811]: cluster 2021-01-27T16:46:13.856857+0000 mon.a (mon.0) 977 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:16.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:15 smithi106 bash[9795]: cluster 2021-01-27T16:46:14.877439+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T16:46:16.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:15 smithi106 bash[13484]: cluster 2021-01-27T16:46:14.877439+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T16:46:16.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:15 smithi094 bash[9811]: cluster 2021-01-27T16:46:14.877439+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-27T16:46:17.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[9795]: cluster 2021-01-27T16:46:15.589468+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v588: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:17.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[9795]: cluster 2021-01-27T16:46:15.873068+0000 mon.a (mon.0) 979 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:17.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[9795]: cluster 2021-01-27T16:46:15.873136+0000 mon.a (mon.0) 980 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:17.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[9795]: cluster 2021-01-27T16:46:15.891078+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T16:46:17.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[9795]: audit 2021-01-27T16:46:15.959534+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:17.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[13484]: cluster 2021-01-27T16:46:15.589468+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v588: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:17.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[13484]: cluster 2021-01-27T16:46:15.873068+0000 mon.a (mon.0) 979 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:17.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[13484]: cluster 2021-01-27T16:46:15.873136+0000 mon.a (mon.0) 980 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:17.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[13484]: cluster 2021-01-27T16:46:15.891078+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T16:46:17.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:16 smithi106 bash[13484]: audit 2021-01-27T16:46:15.959534+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:17.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:16 smithi094 bash[9811]: cluster 2021-01-27T16:46:15.589468+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v588: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:17.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:16 smithi094 bash[9811]: cluster 2021-01-27T16:46:15.873068+0000 mon.a (mon.0) 979 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:17.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:16 smithi094 bash[9811]: cluster 2021-01-27T16:46:15.873136+0000 mon.a (mon.0) 980 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:17.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:16 smithi094 bash[9811]: cluster 2021-01-27T16:46:15.891078+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-27T16:46:17.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:16 smithi094 bash[9811]: audit 2021-01-27T16:46:15.959534+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:17.919 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_list_objects ... ok 2021-01-27T16:46:18.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:17 smithi106 bash[9795]: audit 2021-01-27T16:46:16.901776+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:18.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:17 smithi106 bash[9795]: cluster 2021-01-27T16:46:16.901875+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T16:46:18.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:17 smithi106 bash[13484]: audit 2021-01-27T16:46:16.901776+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:18.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:17 smithi106 bash[13484]: cluster 2021-01-27T16:46:16.901875+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T16:46:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:17 smithi094 bash[9811]: audit 2021-01-27T16:46:16.901776+0000 mon.a (mon.0) 983 : audit [INF] from='client.? 172.21.15.106:0/3500737926' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:18.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:17 smithi094 bash[9811]: cluster 2021-01-27T16:46:16.901875+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-27T16:46:19.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[13484]: cluster 2021-01-27T16:46:17.590667+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v591: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:19.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[13484]: cluster 2021-01-27T16:46:17.910858+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T16:46:19.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[13484]: cluster 2021-01-27T16:46:18.373799+0000 mon.a (mon.0) 986 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:19.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[9795]: cluster 2021-01-27T16:46:17.590667+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v591: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:19.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[9795]: cluster 2021-01-27T16:46:17.910858+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T16:46:19.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:18 smithi106 bash[9795]: cluster 2021-01-27T16:46:18.373799+0000 mon.a (mon.0) 986 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:18 smithi094 bash[9811]: cluster 2021-01-27T16:46:17.590667+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v591: 212 pgs: 6 creating+peering, 9 unknown, 197 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:19.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:18 smithi094 bash[9811]: cluster 2021-01-27T16:46:17.910858+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-27T16:46:19.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:18 smithi094 bash[9811]: cluster 2021-01-27T16:46:18.373799+0000 mon.a (mon.0) 986 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:46:20.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:19 smithi106 bash[9795]: cluster 2021-01-27T16:46:18.918417+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T16:46:20.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:19 smithi106 bash[9795]: cluster 2021-01-27T16:46:19.920443+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T16:46:20.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:19 smithi106 bash[13484]: cluster 2021-01-27T16:46:18.918417+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T16:46:20.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:19 smithi106 bash[13484]: cluster 2021-01-27T16:46:19.920443+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T16:46:20.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:19 smithi094 bash[9811]: cluster 2021-01-27T16:46:18.918417+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-27T16:46:20.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:19 smithi094 bash[9811]: cluster 2021-01-27T16:46:19.920443+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-27T16:46:21.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: cluster 2021-01-27T16:46:19.591746+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v594: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:21.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: cluster 2021-01-27T16:46:19.935556+0000 mon.a (mon.0) 989 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:21.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: cluster 2021-01-27T16:46:19.935604+0000 mon.a (mon.0) 990 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:21.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: audit 2021-01-27T16:46:19.973162+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:21.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: audit 2021-01-27T16:46:20.926462+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:21.205 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[9795]: cluster 2021-01-27T16:46:20.926679+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T16:46:21.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: cluster 2021-01-27T16:46:19.591746+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v594: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:21.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: cluster 2021-01-27T16:46:19.935556+0000 mon.a (mon.0) 989 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:21.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: cluster 2021-01-27T16:46:19.935604+0000 mon.a (mon.0) 990 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:21.206 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: audit 2021-01-27T16:46:19.973162+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:21.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: audit 2021-01-27T16:46:20.926462+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:21.207 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:20 smithi106 bash[13484]: cluster 2021-01-27T16:46:20.926679+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T16:46:21.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: cluster 2021-01-27T16:46:19.591746+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v594: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:21.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: cluster 2021-01-27T16:46:19.935556+0000 mon.a (mon.0) 989 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:46:21.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: cluster 2021-01-27T16:46:19.935604+0000 mon.a (mon.0) 990 : cluster [INF] Cluster is now healthy 2021-01-27T16:46:21.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: audit 2021-01-27T16:46:19.973162+0000 mon.a (mon.0) 991 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:21.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: audit 2021-01-27T16:46:20.926462+0000 mon.a (mon.0) 992 : audit [INF] from='client.? 172.21.15.106:0/893987808' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:21.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:20 smithi094 bash[9811]: cluster 2021-01-27T16:46:20.926679+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-27T16:46:21.931 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_list_objects_empty ... ok 2021-01-27T16:46:22.203 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:21 smithi106 bash[10032]: debug 2021-01-27T16:46:21.905+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:22.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:23.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[9795]: cluster 2021-01-27T16:46:21.592816+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v597: 212 pgs: 2 creating+peering, 17 unknown, 193 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:23.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[9795]: audit 2021-01-27T16:46:21.907877+0000 mgr.y (mgr.14138) 595 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:23.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[9795]: cluster 2021-01-27T16:46:21.927057+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T16:46:23.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[13484]: cluster 2021-01-27T16:46:21.592816+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v597: 212 pgs: 2 creating+peering, 17 unknown, 193 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:23.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[13484]: audit 2021-01-27T16:46:21.907877+0000 mgr.y (mgr.14138) 595 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:23.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:22 smithi106 bash[13484]: cluster 2021-01-27T16:46:21.927057+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T16:46:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:22 smithi094 bash[9811]: cluster 2021-01-27T16:46:21.592816+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v597: 212 pgs: 2 creating+peering, 17 unknown, 193 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:22 smithi094 bash[9811]: audit 2021-01-27T16:46:21.907877+0000 mgr.y (mgr.14138) 595 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:23.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:22 smithi094 bash[9811]: cluster 2021-01-27T16:46:21.927057+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-27T16:46:24.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:23 smithi094 bash[9811]: cluster 2021-01-27T16:46:22.950270+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T16:46:24.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:23 smithi106 bash[9795]: cluster 2021-01-27T16:46:22.950270+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T16:46:24.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:23 smithi106 bash[13484]: cluster 2021-01-27T16:46:22.950270+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-27T16:46:25.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:24 smithi094 bash[9811]: cluster 2021-01-27T16:46:23.593788+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v600: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:25.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:24 smithi094 bash[9811]: cluster 2021-01-27T16:46:23.953345+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T16:46:25.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:24 smithi106 bash[13484]: cluster 2021-01-27T16:46:23.593788+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v600: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:25.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:24 smithi106 bash[13484]: cluster 2021-01-27T16:46:23.953345+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T16:46:25.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:24 smithi106 bash[9795]: cluster 2021-01-27T16:46:23.593788+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v600: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:25.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:24 smithi106 bash[9795]: cluster 2021-01-27T16:46:23.953345+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-27T16:46:26.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:25 smithi094 bash[9811]: cluster 2021-01-27T16:46:24.957359+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T16:46:26.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:25 smithi094 bash[9811]: audit 2021-01-27T16:46:25.775863+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:46:26.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:25 smithi106 bash[13484]: cluster 2021-01-27T16:46:24.957359+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T16:46:26.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:25 smithi106 bash[13484]: audit 2021-01-27T16:46:25.775863+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:46:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:25 smithi106 bash[9795]: cluster 2021-01-27T16:46:24.957359+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-27T16:46:26.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:25 smithi106 bash[9795]: audit 2021-01-27T16:46:25.775863+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:46:27.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:26 smithi094 bash[9811]: cluster 2021-01-27T16:46:25.594975+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v603: 212 pgs: 2 creating+peering, 12 unknown, 198 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:27.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:26 smithi094 bash[9811]: cluster 2021-01-27T16:46:25.960554+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T16:46:27.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:26 smithi094 bash[9811]: audit 2021-01-27T16:46:25.963681+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:27.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[9795]: cluster 2021-01-27T16:46:25.594975+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v603: 212 pgs: 2 creating+peering, 12 unknown, 198 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:27.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[9795]: cluster 2021-01-27T16:46:25.960554+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T16:46:27.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[9795]: audit 2021-01-27T16:46:25.963681+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:27.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[13484]: cluster 2021-01-27T16:46:25.594975+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v603: 212 pgs: 2 creating+peering, 12 unknown, 198 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:27.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[13484]: cluster 2021-01-27T16:46:25.960554+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-27T16:46:27.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:26 smithi106 bash[13484]: audit 2021-01-27T16:46:25.963681+0000 mon.a (mon.0) 1000 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:27.967 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_list_snaps ... ok 2021-01-27T16:46:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:27 smithi094 bash[9811]: audit 2021-01-27T16:46:26.962333+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:27 smithi094 bash[9811]: cluster 2021-01-27T16:46:26.962812+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T16:46:28.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:27 smithi094 bash[9811]: cluster 2021-01-27T16:46:27.963789+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T16:46:28.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[13484]: audit 2021-01-27T16:46:26.962333+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:28.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[13484]: cluster 2021-01-27T16:46:26.962812+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T16:46:28.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[13484]: cluster 2021-01-27T16:46:27.963789+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T16:46:28.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[9795]: audit 2021-01-27T16:46:26.962333+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? 172.21.15.106:0/794645187' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:28.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[9795]: cluster 2021-01-27T16:46:26.962812+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-27T16:46:28.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:27 smithi106 bash[9795]: cluster 2021-01-27T16:46:27.963789+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-27T16:46:29.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[9795]: cluster 2021-01-27T16:46:27.596234+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v606: 212 pgs: 2 creating+peering, 5 unknown, 205 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:29.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[9795]: cluster 2021-01-27T16:46:28.988553+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T16:46:29.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[9795]: audit 2021-01-27T16:46:28.990302+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.106:0/2890714889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:29.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[9795]: audit 2021-01-27T16:46:28.994138+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:29.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[13484]: cluster 2021-01-27T16:46:27.596234+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v606: 212 pgs: 2 creating+peering, 5 unknown, 205 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:29.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[13484]: cluster 2021-01-27T16:46:28.988553+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T16:46:29.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[13484]: audit 2021-01-27T16:46:28.990302+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.106:0/2890714889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:29.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:29 smithi106 bash[13484]: audit 2021-01-27T16:46:28.994138+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:29.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:29 smithi094 bash[9811]: cluster 2021-01-27T16:46:27.596234+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v606: 212 pgs: 2 creating+peering, 5 unknown, 205 active+clean; 25 KiB data, 211 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:29.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:29 smithi094 bash[9811]: cluster 2021-01-27T16:46:28.988553+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-27T16:46:29.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:29 smithi094 bash[9811]: audit 2021-01-27T16:46:28.990302+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.106:0/2890714889' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:29.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:29 smithi094 bash[9811]: audit 2021-01-27T16:46:28.994138+0000 mon.a (mon.0) 1005 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:30.994 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_list_snaps_empty ... ok 2021-01-27T16:46:31.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:30 smithi094 bash[9811]: cluster 2021-01-27T16:46:29.597185+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v609: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:31.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:30 smithi094 bash[9811]: audit 2021-01-27T16:46:29.988197+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:31.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:30 smithi094 bash[9811]: cluster 2021-01-27T16:46:29.990289+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T16:46:31.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[13484]: cluster 2021-01-27T16:46:29.597185+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v609: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:31.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[13484]: audit 2021-01-27T16:46:29.988197+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:31.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[13484]: cluster 2021-01-27T16:46:29.990289+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T16:46:31.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[9795]: cluster 2021-01-27T16:46:29.597185+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v609: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:31.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[9795]: audit 2021-01-27T16:46:29.988197+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:31.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:30 smithi106 bash[9795]: cluster 2021-01-27T16:46:29.990289+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-27T16:46:32.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:32 smithi106 bash[9795]: cluster 2021-01-27T16:46:30.987826+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T16:46:32.205 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:31 smithi106 bash[10032]: debug 2021-01-27T16:46:31.905+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:32.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:32 smithi106 bash[13484]: cluster 2021-01-27T16:46:30.987826+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T16:46:32.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:32 smithi094 bash[9811]: cluster 2021-01-27T16:46:30.987826+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-27T16:46:32.287 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:33.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:33 smithi094 bash[9811]: cluster 2021-01-27T16:46:31.598265+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:33.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:33 smithi094 bash[9811]: audit 2021-01-27T16:46:31.909733+0000 mgr.y (mgr.14138) 601 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:33.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:33 smithi094 bash[9811]: cluster 2021-01-27T16:46:32.005953+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T16:46:33.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:33 smithi094 bash[9811]: audit 2021-01-27T16:46:32.833665+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:46:33.288 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:33 smithi094 bash[9811]: cluster 2021-01-27T16:46:33.012333+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T16:46:33.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[9795]: cluster 2021-01-27T16:46:31.598265+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:33.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[9795]: audit 2021-01-27T16:46:31.909733+0000 mgr.y (mgr.14138) 601 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:33.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[9795]: cluster 2021-01-27T16:46:32.005953+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T16:46:33.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[9795]: audit 2021-01-27T16:46:32.833665+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:46:33.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[9795]: cluster 2021-01-27T16:46:33.012333+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T16:46:33.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[13484]: cluster 2021-01-27T16:46:31.598265+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:33.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[13484]: audit 2021-01-27T16:46:31.909733+0000 mgr.y (mgr.14138) 601 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:33.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[13484]: cluster 2021-01-27T16:46:32.005953+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-27T16:46:33.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[13484]: audit 2021-01-27T16:46:32.833665+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-27T16:46:33.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:33 smithi106 bash[13484]: cluster 2021-01-27T16:46:33.012333+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-27T16:46:34.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:34 smithi094 bash[9811]: audit 2021-01-27T16:46:33.115149+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.106:0/1274284510' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:34.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:34 smithi094 bash[9811]: audit 2021-01-27T16:46:33.115957+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:34.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:34 smithi106 bash[9795]: audit 2021-01-27T16:46:33.115149+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.106:0/1274284510' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:34.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:34 smithi106 bash[9795]: audit 2021-01-27T16:46:33.115957+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:34.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:34 smithi106 bash[13484]: audit 2021-01-27T16:46:33.115149+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.106:0/1274284510' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:34.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:34 smithi106 bash[13484]: audit 2021-01-27T16:46:33.115957+0000 mon.a (mon.0) 1012 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:35.047 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_locator ... ok 2021-01-27T16:46:35.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[9795]: cluster 2021-01-27T16:46:33.599291+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 15 unknown, 185 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:35.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[9795]: audit 2021-01-27T16:46:34.036165+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:35.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[9795]: cluster 2021-01-27T16:46:34.036344+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T16:46:35.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[13484]: cluster 2021-01-27T16:46:33.599291+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 15 unknown, 185 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:35.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[13484]: audit 2021-01-27T16:46:34.036165+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:35.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:35 smithi106 bash[13484]: cluster 2021-01-27T16:46:34.036344+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T16:46:35.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:35 smithi094 bash[9811]: cluster 2021-01-27T16:46:33.599291+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 15 unknown, 185 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:35.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:35 smithi094 bash[9811]: audit 2021-01-27T16:46:34.036165+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:35.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:35 smithi094 bash[9811]: cluster 2021-01-27T16:46:34.036344+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-27T16:46:36.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:36 smithi106 bash[9795]: cluster 2021-01-27T16:46:35.042632+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T16:46:36.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:36 smithi106 bash[13484]: cluster 2021-01-27T16:46:35.042632+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T16:46:36.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:36 smithi094 bash[9811]: cluster 2021-01-27T16:46:35.042632+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-27T16:46:37.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:37 smithi106 bash[9795]: cluster 2021-01-27T16:46:35.600339+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:37.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:37 smithi106 bash[9795]: cluster 2021-01-27T16:46:36.064983+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T16:46:37.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:37 smithi106 bash[13484]: cluster 2021-01-27T16:46:35.600339+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:37.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:37 smithi106 bash[13484]: cluster 2021-01-27T16:46:36.064983+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T16:46:37.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:37 smithi094 bash[9811]: cluster 2021-01-27T16:46:35.600339+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v618: 180 pgs: 180 active+clean; 25 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:37.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:37 smithi094 bash[9811]: cluster 2021-01-27T16:46:36.064983+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-27T16:46:38.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:38 smithi106 bash[9795]: cluster 2021-01-27T16:46:37.068598+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T16:46:38.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:38 smithi106 bash[9795]: audit 2021-01-27T16:46:37.120451+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:38.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:38 smithi106 bash[13484]: cluster 2021-01-27T16:46:37.068598+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T16:46:38.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:38 smithi106 bash[13484]: audit 2021-01-27T16:46:37.120451+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:38.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:38 smithi094 bash[9811]: cluster 2021-01-27T16:46:37.068598+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-27T16:46:38.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:38 smithi094 bash[9811]: audit 2021-01-27T16:46:37.120451+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:39.095 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_lock ... ok 2021-01-27T16:46:39.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[9795]: cluster 2021-01-27T16:46:37.601465+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v621: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:39.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[9795]: audit 2021-01-27T16:46:38.083978+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:39.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[9795]: cluster 2021-01-27T16:46:38.084229+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T16:46:39.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[13484]: cluster 2021-01-27T16:46:37.601465+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v621: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:39.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[13484]: audit 2021-01-27T16:46:38.083978+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:39.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:39 smithi106 bash[13484]: cluster 2021-01-27T16:46:38.084229+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T16:46:39.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:39 smithi094 bash[9811]: cluster 2021-01-27T16:46:37.601465+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v621: 212 pgs: 6 creating+peering, 15 unknown, 191 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:39.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:39 smithi094 bash[9811]: audit 2021-01-27T16:46:38.083978+0000 mon.a (mon.0) 1019 : audit [INF] from='client.? 172.21.15.106:0/2717840772' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:39.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:39 smithi094 bash[9811]: cluster 2021-01-27T16:46:38.084229+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-27T16:46:40.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:40 smithi106 bash[9795]: cluster 2021-01-27T16:46:39.088074+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T16:46:40.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:40 smithi106 bash[13484]: cluster 2021-01-27T16:46:39.088074+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T16:46:40.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:40 smithi094 bash[9811]: cluster 2021-01-27T16:46:39.088074+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-27T16:46:41.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:41 smithi106 bash[9795]: cluster 2021-01-27T16:46:39.602289+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:41.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:41 smithi106 bash[9795]: cluster 2021-01-27T16:46:40.121051+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T16:46:41.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:41 smithi106 bash[13484]: cluster 2021-01-27T16:46:39.602289+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:41.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:41 smithi106 bash[13484]: cluster 2021-01-27T16:46:40.121051+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T16:46:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:41 smithi094 bash[9811]: cluster 2021-01-27T16:46:39.602289+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v624: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:41.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:41 smithi094 bash[9811]: cluster 2021-01-27T16:46:40.121051+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-27T16:46:42.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[9795]: cluster 2021-01-27T16:46:41.126588+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T16:46:42.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[9795]: audit 2021-01-27T16:46:41.129964+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.106:0/1017294392' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:42.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[9795]: audit 2021-01-27T16:46:41.140976+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:42.205 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:41 smithi106 bash[10032]: debug 2021-01-27T16:46:41.917+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:42.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[13484]: cluster 2021-01-27T16:46:41.126588+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T16:46:42.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[13484]: audit 2021-01-27T16:46:41.129964+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.106:0/1017294392' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:42.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:42 smithi106 bash[13484]: audit 2021-01-27T16:46:41.140976+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:42.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:41 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:42.286 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:42 smithi094 bash[9811]: cluster 2021-01-27T16:46:41.126588+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-27T16:46:42.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:42 smithi094 bash[9811]: audit 2021-01-27T16:46:41.129964+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.106:0/1017294392' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:42.287 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:42 smithi094 bash[9811]: audit 2021-01-27T16:46:41.140976+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:43.166 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_lookup_snap ... ok 2021-01-27T16:46:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[9795]: cluster 2021-01-27T16:46:41.603364+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v627: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:43.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[9795]: audit 2021-01-27T16:46:41.921005+0000 mgr.y (mgr.14138) 607 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:43.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[9795]: audit 2021-01-27T16:46:42.145837+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:43.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[9795]: cluster 2021-01-27T16:46:42.146065+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T16:46:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[13484]: cluster 2021-01-27T16:46:41.603364+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v627: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[13484]: audit 2021-01-27T16:46:41.921005+0000 mgr.y (mgr.14138) 607 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:43.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[13484]: audit 2021-01-27T16:46:42.145837+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:43.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:43 smithi106 bash[13484]: cluster 2021-01-27T16:46:42.146065+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T16:46:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:43 smithi094 bash[9811]: cluster 2021-01-27T16:46:41.603364+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v627: 212 pgs: 7 creating+peering, 22 unknown, 183 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:43 smithi094 bash[9811]: audit 2021-01-27T16:46:41.921005+0000 mgr.y (mgr.14138) 607 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:43.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:43 smithi094 bash[9811]: audit 2021-01-27T16:46:42.145837+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:43.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:43 smithi094 bash[9811]: cluster 2021-01-27T16:46:42.146065+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-27T16:46:44.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:44 smithi106 bash[9795]: cluster 2021-01-27T16:46:43.158949+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T16:46:44.454 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:44 smithi106 bash[13484]: cluster 2021-01-27T16:46:43.158949+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T16:46:44.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:44 smithi094 bash[9811]: cluster 2021-01-27T16:46:43.158949+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-27T16:46:45.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:45 smithi106 bash[9795]: cluster 2021-01-27T16:46:43.604343+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:45.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:45 smithi106 bash[9795]: cluster 2021-01-27T16:46:44.181949+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T16:46:45.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:45 smithi106 bash[13484]: cluster 2021-01-27T16:46:43.604343+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:45.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:45 smithi106 bash[13484]: cluster 2021-01-27T16:46:44.181949+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T16:46:45.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:45 smithi094 bash[9811]: cluster 2021-01-27T16:46:43.604343+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v630: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:45.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:45 smithi094 bash[9811]: cluster 2021-01-27T16:46:44.181949+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-27T16:46:46.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[9795]: cluster 2021-01-27T16:46:45.186457+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T16:46:46.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[9795]: audit 2021-01-27T16:46:45.268244+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.106:0/31555705' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:46.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[9795]: audit 2021-01-27T16:46:45.268803+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:46.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[13484]: cluster 2021-01-27T16:46:45.186457+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T16:46:46.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[13484]: audit 2021-01-27T16:46:45.268244+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.106:0/31555705' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:46.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:46 smithi106 bash[13484]: audit 2021-01-27T16:46:45.268803+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:46.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:46 smithi094 bash[9811]: cluster 2021-01-27T16:46:45.186457+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-27T16:46:46.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:46 smithi094 bash[9811]: audit 2021-01-27T16:46:45.268244+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.106:0/31555705' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:46.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:46 smithi094 bash[9811]: audit 2021-01-27T16:46:45.268803+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:47.227 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_obj_xattrs ... ok 2021-01-27T16:46:47.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:47 smithi094 bash[9811]: cluster 2021-01-27T16:46:45.605347+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v633: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:47.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:47 smithi094 bash[9811]: audit 2021-01-27T16:46:46.210124+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:47.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:47 smithi094 bash[9811]: cluster 2021-01-27T16:46:46.210260+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T16:46:47.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[9795]: cluster 2021-01-27T16:46:45.605347+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v633: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:47.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[9795]: audit 2021-01-27T16:46:46.210124+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:47.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[9795]: cluster 2021-01-27T16:46:46.210260+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T16:46:47.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[13484]: cluster 2021-01-27T16:46:45.605347+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v633: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 218 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:47.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[13484]: audit 2021-01-27T16:46:46.210124+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:47.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:47 smithi106 bash[13484]: cluster 2021-01-27T16:46:46.210260+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-27T16:46:48.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:48 smithi094 bash[9811]: cluster 2021-01-27T16:46:47.217137+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T16:46:48.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:48 smithi106 bash[9795]: cluster 2021-01-27T16:46:47.217137+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T16:46:48.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:48 smithi106 bash[13484]: cluster 2021-01-27T16:46:47.217137+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-27T16:46:49.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:49 smithi094 bash[9811]: cluster 2021-01-27T16:46:47.606225+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:49.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:49 smithi094 bash[9811]: cluster 2021-01-27T16:46:48.237234+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T16:46:49.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:49 smithi106 bash[9795]: cluster 2021-01-27T16:46:47.606225+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:49.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:49 smithi106 bash[9795]: cluster 2021-01-27T16:46:48.237234+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T16:46:49.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:49 smithi106 bash[13484]: cluster 2021-01-27T16:46:47.606225+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v636: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:49.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:49 smithi106 bash[13484]: cluster 2021-01-27T16:46:48.237234+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-27T16:46:50.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:50 smithi094 bash[9811]: cluster 2021-01-27T16:46:49.243130+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T16:46:50.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:50 smithi094 bash[9811]: audit 2021-01-27T16:46:49.277766+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:50.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:50 smithi106 bash[9795]: cluster 2021-01-27T16:46:49.243130+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T16:46:50.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:50 smithi106 bash[9795]: audit 2021-01-27T16:46:49.277766+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:50.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:50 smithi106 bash[13484]: cluster 2021-01-27T16:46:49.243130+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-27T16:46:50.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:50 smithi106 bash[13484]: audit 2021-01-27T16:46:49.277766+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:51.270 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_operate_aio_write_op ... ok 2021-01-27T16:46:51.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:51 smithi094 bash[9811]: cluster 2021-01-27T16:46:49.607129+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v639: 212 pgs: 3 creating+peering, 25 unknown, 184 active+clean; 25 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:51.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:51 smithi094 bash[9811]: audit 2021-01-27T16:46:50.257782+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:51.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:51 smithi094 bash[9811]: cluster 2021-01-27T16:46:50.257937+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T16:46:51.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[9795]: cluster 2021-01-27T16:46:49.607129+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v639: 212 pgs: 3 creating+peering, 25 unknown, 184 active+clean; 25 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:51.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[9795]: audit 2021-01-27T16:46:50.257782+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:51.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[9795]: cluster 2021-01-27T16:46:50.257937+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T16:46:51.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[13484]: cluster 2021-01-27T16:46:49.607129+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v639: 212 pgs: 3 creating+peering, 25 unknown, 184 active+clean; 25 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:46:51.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[13484]: audit 2021-01-27T16:46:50.257782+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.106:0/646859422' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:51.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[13484]: cluster 2021-01-27T16:46:50.257937+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-27T16:46:52.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:46:51 smithi106 bash[10032]: debug 2021-01-27T16:46:51.925+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:46:52.285 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:46:51 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:46:52.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:52 smithi094 bash[9811]: cluster 2021-01-27T16:46:51.265850+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T16:46:52.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:52 smithi106 bash[9795]: cluster 2021-01-27T16:46:51.265850+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T16:46:52.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:52 smithi106 bash[13484]: cluster 2021-01-27T16:46:51.265850+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-27T16:46:53.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[9795]: cluster 2021-01-27T16:46:51.608068+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v642: 180 pgs: 180 active+clean; 25 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:53.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[9795]: audit 2021-01-27T16:46:51.928945+0000 mgr.y (mgr.14138) 613 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:53.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[9795]: cluster 2021-01-27T16:46:52.294356+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T16:46:53.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[13484]: cluster 2021-01-27T16:46:51.608068+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v642: 180 pgs: 180 active+clean; 25 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:53.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[13484]: audit 2021-01-27T16:46:51.928945+0000 mgr.y (mgr.14138) 613 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:53.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:53 smithi106 bash[13484]: cluster 2021-01-27T16:46:52.294356+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T16:46:53.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:53 smithi094 bash[9811]: cluster 2021-01-27T16:46:51.608068+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v642: 180 pgs: 180 active+clean; 25 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:53.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:53 smithi094 bash[9811]: audit 2021-01-27T16:46:51.928945+0000 mgr.y (mgr.14138) 613 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:46:53.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:53 smithi094 bash[9811]: cluster 2021-01-27T16:46:52.294356+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-27T16:46:54.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[9795]: cluster 2021-01-27T16:46:53.293112+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T16:46:54.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[9795]: audit 2021-01-27T16:46:53.326676+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.106:0/3468149368' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:54.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[9795]: audit 2021-01-27T16:46:53.327194+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:54.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[13484]: cluster 2021-01-27T16:46:53.293112+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T16:46:54.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[13484]: audit 2021-01-27T16:46:53.326676+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.106:0/3468149368' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:54.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:54 smithi106 bash[13484]: audit 2021-01-27T16:46:53.327194+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:54.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:54 smithi094 bash[9811]: cluster 2021-01-27T16:46:53.293112+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-27T16:46:54.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:54 smithi094 bash[9811]: audit 2021-01-27T16:46:53.326676+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.106:0/3468149368' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:54.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:54 smithi094 bash[9811]: audit 2021-01-27T16:46:53.327194+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:55.343 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_remove_omap_ramge2 ... ok 2021-01-27T16:46:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[9795]: cluster 2021-01-27T16:46:53.609043+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v645: 212 pgs: 10 creating+peering, 17 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[9795]: audit 2021-01-27T16:46:54.323003+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:55.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[9795]: cluster 2021-01-27T16:46:54.323088+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T16:46:55.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[13484]: cluster 2021-01-27T16:46:53.609043+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v645: 212 pgs: 10 creating+peering, 17 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:55.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[13484]: audit 2021-01-27T16:46:54.323003+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:55.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:55 smithi106 bash[13484]: cluster 2021-01-27T16:46:54.323088+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T16:46:55.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:55 smithi094 bash[9811]: cluster 2021-01-27T16:46:53.609043+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v645: 212 pgs: 10 creating+peering, 17 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:55.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:55 smithi094 bash[9811]: audit 2021-01-27T16:46:54.323003+0000 mon.a (mon.0) 1043 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:46:55.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:55 smithi094 bash[9811]: cluster 2021-01-27T16:46:54.323088+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-27T16:46:56.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:56 smithi106 bash[9795]: cluster 2021-01-27T16:46:55.330367+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T16:46:56.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:56 smithi106 bash[13484]: cluster 2021-01-27T16:46:55.330367+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T16:46:56.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:56 smithi094 bash[9811]: cluster 2021-01-27T16:46:55.330367+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-27T16:46:57.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:57 smithi106 bash[9795]: cluster 2021-01-27T16:46:55.609927+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:57.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:57 smithi106 bash[9795]: cluster 2021-01-27T16:46:56.352481+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T16:46:57.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:57 smithi106 bash[13484]: cluster 2021-01-27T16:46:55.609927+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:57.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:57 smithi106 bash[13484]: cluster 2021-01-27T16:46:56.352481+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T16:46:57.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:57 smithi094 bash[9811]: cluster 2021-01-27T16:46:55.609927+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v648: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:57.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:57 smithi094 bash[9811]: cluster 2021-01-27T16:46:56.352481+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-27T16:46:58.703 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:58 smithi106 bash[9795]: cluster 2021-01-27T16:46:57.362269+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T16:46:58.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:58 smithi106 bash[13484]: cluster 2021-01-27T16:46:57.362269+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T16:46:58.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:58 smithi094 bash[9811]: cluster 2021-01-27T16:46:57.362269+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-27T16:46:59.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[9795]: cluster 2021-01-27T16:46:57.610867+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v651: 212 pgs: 5 creating+peering, 21 unknown, 186 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:59.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[9795]: cluster 2021-01-27T16:46:58.376192+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T16:46:59.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[9795]: audit 2021-01-27T16:46:58.377849+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.106:0/3470617426' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:59.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[9795]: audit 2021-01-27T16:46:58.378607+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:59.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[13484]: cluster 2021-01-27T16:46:57.610867+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v651: 212 pgs: 5 creating+peering, 21 unknown, 186 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:59.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[13484]: cluster 2021-01-27T16:46:58.376192+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T16:46:59.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[13484]: audit 2021-01-27T16:46:58.377849+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.106:0/3470617426' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:59.706 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:46:59 smithi106 bash[13484]: audit 2021-01-27T16:46:58.378607+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:59.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:59 smithi094 bash[9811]: cluster 2021-01-27T16:46:57.610867+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v651: 212 pgs: 5 creating+peering, 21 unknown, 186 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:46:59.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:59 smithi094 bash[9811]: cluster 2021-01-27T16:46:58.376192+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-27T16:46:59.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:59 smithi094 bash[9811]: audit 2021-01-27T16:46:58.377849+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.106:0/3470617426' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:46:59.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:46:59 smithi094 bash[9811]: audit 2021-01-27T16:46:58.378607+0000 mon.a (mon.0) 1049 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:00.399 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_remove_snap ... ok 2021-01-27T16:47:00.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:00 smithi106 bash[9795]: audit 2021-01-27T16:46:59.381332+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:00.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:00 smithi106 bash[9795]: cluster 2021-01-27T16:46:59.381420+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T16:47:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:00 smithi106 bash[13484]: audit 2021-01-27T16:46:59.381332+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:00.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:00 smithi106 bash[13484]: cluster 2021-01-27T16:46:59.381420+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T16:47:00.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:00 smithi094 bash[9811]: audit 2021-01-27T16:46:59.381332+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:00.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:00 smithi094 bash[9811]: cluster 2021-01-27T16:46:59.381420+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-27T16:47:01.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:01 smithi106 bash[9795]: cluster 2021-01-27T16:46:59.611840+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v654: 212 pgs: 5 creating+peering, 7 unknown, 200 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:01.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:01 smithi106 bash[9795]: cluster 2021-01-27T16:47:00.396143+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T16:47:01.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:01 smithi106 bash[13484]: cluster 2021-01-27T16:46:59.611840+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v654: 212 pgs: 5 creating+peering, 7 unknown, 200 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:01.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:01 smithi106 bash[13484]: cluster 2021-01-27T16:47:00.396143+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T16:47:01.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:01 smithi094 bash[9811]: cluster 2021-01-27T16:46:59.611840+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v654: 212 pgs: 5 creating+peering, 7 unknown, 200 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:01.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:01 smithi094 bash[9811]: cluster 2021-01-27T16:47:00.396143+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-27T16:47:02.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:47:01 smithi106 bash[10032]: debug 2021-01-27T16:47:01.932+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:47:02.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:47:01 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:47:02.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:02 smithi106 bash[13484]: cluster 2021-01-27T16:47:01.421468+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T16:47:02.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:02 smithi106 bash[13484]: audit 2021-01-27T16:47:01.426726+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:02.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:02 smithi106 bash[9795]: cluster 2021-01-27T16:47:01.421468+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T16:47:02.705 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:02 smithi106 bash[9795]: audit 2021-01-27T16:47:01.426726+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:02.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:02 smithi094 bash[9811]: cluster 2021-01-27T16:47:01.421468+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-27T16:47:02.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:02 smithi094 bash[9811]: audit 2021-01-27T16:47:01.426726+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:03.438 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_service_daemon ... ok 2021-01-27T16:47:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[9795]: cluster 2021-01-27T16:47:01.612921+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v657: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[9795]: audit 2021-01-27T16:47:01.937022+0000 mgr.y (mgr.14138) 619 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[9795]: audit 2021-01-27T16:47:02.430413+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:03.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[9795]: cluster 2021-01-27T16:47:02.430677+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T16:47:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[13484]: cluster 2021-01-27T16:47:01.612921+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v657: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[13484]: audit 2021-01-27T16:47:01.937022+0000 mgr.y (mgr.14138) 619 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[13484]: audit 2021-01-27T16:47:02.430413+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:03.705 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:03 smithi106 bash[13484]: cluster 2021-01-27T16:47:02.430677+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T16:47:03.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:03 smithi094 bash[9811]: cluster 2021-01-27T16:47:01.612921+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v657: 212 pgs: 7 creating+peering, 25 unknown, 180 active+clean; 25 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:03.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:03 smithi094 bash[9811]: audit 2021-01-27T16:47:01.937022+0000 mgr.y (mgr.14138) 619 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:03.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:03 smithi094 bash[9811]: audit 2021-01-27T16:47:02.430413+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? 172.21.15.106:0/2672543987' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:03.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:03 smithi094 bash[9811]: cluster 2021-01-27T16:47:02.430677+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-27T16:47:04.704 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:04 smithi106 bash[9795]: cluster 2021-01-27T16:47:03.433303+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T16:47:04.704 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:04 smithi106 bash[13484]: cluster 2021-01-27T16:47:03.433303+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T16:47:04.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:04 smithi094 bash[9811]: cluster 2021-01-27T16:47:03.433303+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-27T16:47:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:05 smithi094 bash[9811]: cluster 2021-01-27T16:47:03.614073+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:05.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:05 smithi094 bash[9811]: cluster 2021-01-27T16:47:04.456209+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T16:47:05.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:05 smithi106 bash[13484]: cluster 2021-01-27T16:47:03.614073+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:05.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:05 smithi106 bash[13484]: cluster 2021-01-27T16:47:04.456209+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T16:47:05.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:05 smithi106 bash[9795]: cluster 2021-01-27T16:47:03.614073+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v660: 180 pgs: 180 active+clean; 25 KiB data, 240 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:05.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:05 smithi106 bash[9795]: cluster 2021-01-27T16:47:04.456209+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-27T16:47:06.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:06 smithi094 bash[9811]: cluster 2021-01-27T16:47:05.460438+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T16:47:06.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:06 smithi094 bash[9811]: audit 2021-01-27T16:47:05.501119+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:06.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:06 smithi106 bash[9795]: cluster 2021-01-27T16:47:05.460438+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T16:47:06.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:06 smithi106 bash[9795]: audit 2021-01-27T16:47:05.501119+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:06.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:06 smithi106 bash[13484]: cluster 2021-01-27T16:47:05.460438+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-27T16:47:06.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:06 smithi106 bash[13484]: audit 2021-01-27T16:47:05.501119+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:07.495 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_set_omap ... ok 2021-01-27T16:47:07.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:07 smithi094 bash[9811]: cluster 2021-01-27T16:47:05.615083+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 20 unknown, 186 active+clean; 25 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:07.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:07 smithi094 bash[9811]: audit 2021-01-27T16:47:06.484919+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:07.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:07 smithi094 bash[9811]: cluster 2021-01-27T16:47:06.485155+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T16:47:07.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[9795]: cluster 2021-01-27T16:47:05.615083+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 20 unknown, 186 active+clean; 25 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:07.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[9795]: audit 2021-01-27T16:47:06.484919+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:07.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[9795]: cluster 2021-01-27T16:47:06.485155+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T16:47:07.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[13484]: cluster 2021-01-27T16:47:05.615083+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v663: 212 pgs: 6 creating+peering, 20 unknown, 186 active+clean; 25 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:07.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[13484]: audit 2021-01-27T16:47:06.484919+0000 mon.a (mon.0) 1061 : audit [INF] from='client.? 172.21.15.106:0/1541640151' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:07.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:07 smithi106 bash[13484]: cluster 2021-01-27T16:47:06.485155+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-27T16:47:08.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:08 smithi094 bash[9811]: cluster 2021-01-27T16:47:07.488114+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T16:47:08.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:08 smithi106 bash[9795]: cluster 2021-01-27T16:47:07.488114+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T16:47:08.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:08 smithi106 bash[13484]: cluster 2021-01-27T16:47:07.488114+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-27T16:47:09.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:09 smithi094 bash[9811]: cluster 2021-01-27T16:47:07.615967+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v666: 180 pgs: 180 active+clean; 25 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:09.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:09 smithi094 bash[9811]: cluster 2021-01-27T16:47:08.508705+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T16:47:09.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:09 smithi106 bash[13484]: cluster 2021-01-27T16:47:07.615967+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v666: 180 pgs: 180 active+clean; 25 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:09.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:09 smithi106 bash[13484]: cluster 2021-01-27T16:47:08.508705+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T16:47:09.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:09 smithi106 bash[9795]: cluster 2021-01-27T16:47:07.615967+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v666: 180 pgs: 180 active+clean; 25 KiB data, 246 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:09.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:09 smithi106 bash[9795]: cluster 2021-01-27T16:47:08.508705+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-27T16:47:10.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:10 smithi094 bash[9811]: cluster 2021-01-27T16:47:09.520853+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T16:47:10.786 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:10 smithi094 bash[9811]: audit 2021-01-27T16:47:09.555785+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.106:0/1428341405' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:10.787 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:10 smithi094 bash[9811]: audit 2021-01-27T16:47:09.556291+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:10.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[9795]: cluster 2021-01-27T16:47:09.520853+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T16:47:10.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[9795]: audit 2021-01-27T16:47:09.555785+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.106:0/1428341405' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:10.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[9795]: audit 2021-01-27T16:47:09.556291+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:10.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[13484]: cluster 2021-01-27T16:47:09.520853+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-27T16:47:10.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[13484]: audit 2021-01-27T16:47:09.555785+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.106:0/1428341405' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:10.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:10 smithi106 bash[13484]: audit 2021-01-27T16:47:09.556291+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:11.547 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_set_omap_aio ... ok 2021-01-27T16:47:11.945 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[13484]: cluster 2021-01-27T16:47:09.616781+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v669: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:11.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[13484]: audit 2021-01-27T16:47:10.531808+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:11.946 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[13484]: cluster 2021-01-27T16:47:10.531945+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T16:47:11.946 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[9795]: cluster 2021-01-27T16:47:09.616781+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v669: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:11.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[9795]: audit 2021-01-27T16:47:10.531808+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:11.947 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[9795]: cluster 2021-01-27T16:47:10.531945+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T16:47:11.947 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:11 smithi094 bash[9811]: cluster 2021-01-27T16:47:09.616781+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v669: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 234 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:11.947 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:11 smithi094 bash[9811]: audit 2021-01-27T16:47:10.531808+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:11.948 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:11 smithi094 bash[9811]: cluster 2021-01-27T16:47:10.531945+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-27T16:47:12.203 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:47:11 smithi106 bash[10032]: debug 2021-01-27T16:47:11.940+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:47:12.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:47:11 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:47:12.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:12 smithi106 bash[9795]: cluster 2021-01-27T16:47:11.540652+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T16:47:12.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:12 smithi106 bash[13484]: cluster 2021-01-27T16:47:11.540652+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T16:47:13.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:12 smithi094 bash[9811]: cluster 2021-01-27T16:47:11.540652+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-27T16:47:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[9795]: cluster 2021-01-27T16:47:11.617444+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v672: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[9795]: audit 2021-01-27T16:47:11.944987+0000 mgr.y (mgr.14138) 625 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:13.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[9795]: cluster 2021-01-27T16:47:12.568532+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T16:47:13.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[13484]: cluster 2021-01-27T16:47:11.617444+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v672: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:13.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[13484]: audit 2021-01-27T16:47:11.944987+0000 mgr.y (mgr.14138) 625 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:13.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:13 smithi106 bash[13484]: cluster 2021-01-27T16:47:12.568532+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T16:47:14.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:13 smithi094 bash[9811]: cluster 2021-01-27T16:47:11.617444+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v672: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:14.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:13 smithi094 bash[9811]: audit 2021-01-27T16:47:11.944987+0000 mgr.y (mgr.14138) 625 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:14.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:13 smithi094 bash[9811]: cluster 2021-01-27T16:47:12.568532+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-27T16:47:14.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:14 smithi106 bash[9795]: cluster 2021-01-27T16:47:13.577506+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T16:47:14.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:14 smithi106 bash[9795]: cluster 2021-01-27T16:47:13.617940+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v675: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:14.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:14 smithi106 bash[13484]: cluster 2021-01-27T16:47:13.577506+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T16:47:14.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:14 smithi106 bash[13484]: cluster 2021-01-27T16:47:13.617940+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v675: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:15.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:14 smithi094 bash[9811]: cluster 2021-01-27T16:47:13.577506+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-27T16:47:15.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:14 smithi094 bash[9811]: cluster 2021-01-27T16:47:13.617940+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v675: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 204 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:15.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:15 smithi106 bash[9795]: cluster 2021-01-27T16:47:14.598444+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T16:47:15.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:15 smithi106 bash[13484]: cluster 2021-01-27T16:47:14.598444+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T16:47:16.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:15 smithi094 bash[9811]: cluster 2021-01-27T16:47:14.598444+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-27T16:47:16.036 INFO:journalctl@ceph.osd.5.smithi094.stdout:Jan 27 16:47:15 smithi094 bash[15110]: debug 2021-01-27T16:47:15.629+0000 7f1fbb945700 -1 osd.5 pg_epoch: 273 pg[54.10( v 272'3 (0'0,272'3] local-lis/les=270/271 n=2 ec=270/270 lis/c=270/270 les/c/f=271/271/0 sis=270) [5,2,0] r=0 lpr=270 crt=272'3 lcod 271'1 mlcod 271'1 active+clean+snaptrim trimq=[1~1]] removing snap head 2021-01-27T16:47:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[13484]: cluster 2021-01-27T16:47:15.610362+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T16:47:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[13484]: audit 2021-01-27T16:47:15.618086+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:16.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[13484]: cluster 2021-01-27T16:47:15.618540+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v678: 212 pgs: 8 creating+peering, 15 unknown, 189 active+clean; 25 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T16:47:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[9795]: cluster 2021-01-27T16:47:15.610362+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T16:47:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[9795]: audit 2021-01-27T16:47:15.618086+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:16.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:16 smithi106 bash[9795]: cluster 2021-01-27T16:47:15.618540+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v678: 212 pgs: 8 creating+peering, 15 unknown, 189 active+clean; 25 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T16:47:17.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:16 smithi094 bash[9811]: cluster 2021-01-27T16:47:15.610362+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-27T16:47:17.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:16 smithi094 bash[9811]: audit 2021-01-27T16:47:15.618086+0000 mon.a (mon.0) 1074 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:17.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:16 smithi094 bash[9811]: cluster 2021-01-27T16:47:15.618540+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v678: 212 pgs: 8 creating+peering, 15 unknown, 189 active+clean; 25 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-27T16:47:17.617 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_snap_read ... ok 2021-01-27T16:47:17.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[9795]: cluster 2021-01-27T16:47:16.603576+0000 mon.a (mon.0) 1075 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:17.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[9795]: audit 2021-01-27T16:47:16.613511+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:17.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[9795]: cluster 2021-01-27T16:47:16.613629+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T16:47:17.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[9795]: cluster 2021-01-27T16:47:17.612943+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T16:47:17.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[13484]: cluster 2021-01-27T16:47:16.603576+0000 mon.a (mon.0) 1075 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:17.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[13484]: audit 2021-01-27T16:47:16.613511+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:17.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[13484]: cluster 2021-01-27T16:47:16.613629+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T16:47:17.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:17 smithi106 bash[13484]: cluster 2021-01-27T16:47:17.612943+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T16:47:18.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:17 smithi094 bash[9811]: cluster 2021-01-27T16:47:16.603576+0000 mon.a (mon.0) 1075 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:18.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:17 smithi094 bash[9811]: audit 2021-01-27T16:47:16.613511+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.106:0/1187845286' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:18.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:17 smithi094 bash[9811]: cluster 2021-01-27T16:47:16.613629+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-27T16:47:18.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:17 smithi094 bash[9811]: cluster 2021-01-27T16:47:17.612943+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-01-27T16:47:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[9795]: cluster 2021-01-27T16:47:17.619168+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v681: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[9795]: cluster 2021-01-27T16:47:18.608168+0000 mon.a (mon.0) 1079 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:19.454 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[9795]: cluster 2021-01-27T16:47:18.608273+0000 mon.a (mon.0) 1080 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:19.455 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[9795]: cluster 2021-01-27T16:47:18.629435+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T16:47:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[13484]: cluster 2021-01-27T16:47:17.619168+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v681: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[13484]: cluster 2021-01-27T16:47:18.608168+0000 mon.a (mon.0) 1079 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:19.455 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[13484]: cluster 2021-01-27T16:47:18.608273+0000 mon.a (mon.0) 1080 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:19.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:19 smithi106 bash[13484]: cluster 2021-01-27T16:47:18.629435+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T16:47:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:19 smithi094 bash[9811]: cluster 2021-01-27T16:47:17.619168+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v681: 180 pgs: 180 active+clean; 25 KiB data, 189 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:19 smithi094 bash[9811]: cluster 2021-01-27T16:47:18.608168+0000 mon.a (mon.0) 1079 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:19.536 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:19 smithi094 bash[9811]: cluster 2021-01-27T16:47:18.608273+0000 mon.a (mon.0) 1080 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:19.537 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:19 smithi094 bash[9811]: cluster 2021-01-27T16:47:18.629435+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-01-27T16:47:20.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:20 smithi106 bash[13484]: cluster 2021-01-27T16:47:19.620173+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v683: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:20.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:20 smithi106 bash[13484]: cluster 2021-01-27T16:47:19.635134+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T16:47:20.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:20 smithi106 bash[9795]: cluster 2021-01-27T16:47:19.620173+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v683: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:20.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:20 smithi106 bash[9795]: cluster 2021-01-27T16:47:19.635134+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T16:47:21.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:20 smithi094 bash[9811]: cluster 2021-01-27T16:47:19.620173+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v683: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:21.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:20 smithi094 bash[9811]: cluster 2021-01-27T16:47:19.635134+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-01-27T16:47:21.953 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:21 smithi106 bash[9795]: cluster 2021-01-27T16:47:20.635871+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T16:47:21.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:21 smithi106 bash[13484]: cluster 2021-01-27T16:47:20.635871+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T16:47:21.954 INFO:journalctl@ceph.osd.3.smithi106.stdout:Jan 27 16:47:21 smithi106 bash[24045]: debug 2021-01-27T16:47:21.656+0000 7f819987e700 -1 osd.3 pg_epoch: 279 pg[55.10( v 279'5 (0'0,279'5] local-lis/les=276/277 n=2 ec=276/276 lis/c=276/276 les/c/f=277/277/0 sis=276) [3,2,7] r=0 lpr=276 luod=278'4 crt=279'5 lcod 278'3 mlcod 278'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2021-01-27T16:47:21.955 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:21 smithi094 bash[9811]: cluster 2021-01-27T16:47:20.635871+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-01-27T16:47:22.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:47:21 smithi106 bash[10032]: debug 2021-01-27T16:47:21.952+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:47:22.286 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:47:21 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:47:22.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[13484]: cluster 2021-01-27T16:47:21.621310+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v686: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:22.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[13484]: cluster 2021-01-27T16:47:21.641071+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:22.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[13484]: cluster 2021-01-27T16:47:21.655727+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T16:47:22.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[13484]: audit 2021-01-27T16:47:21.665082+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:22.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[13484]: audit 2021-01-27T16:47:21.953058+0000 mgr.y (mgr.14138) 631 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:22.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[9795]: cluster 2021-01-27T16:47:21.621310+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v686: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[9795]: cluster 2021-01-27T16:47:21.641071+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[9795]: cluster 2021-01-27T16:47:21.655727+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T16:47:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[9795]: audit 2021-01-27T16:47:21.665082+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:22.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:22 smithi106 bash[9795]: audit 2021-01-27T16:47:21.953058+0000 mgr.y (mgr.14138) 631 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:23.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:22 smithi094 bash[9811]: cluster 2021-01-27T16:47:21.621310+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v686: 212 pgs: 4 creating+peering, 13 unknown, 195 active+clean; 25 KiB data, 175 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:23.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:22 smithi094 bash[9811]: cluster 2021-01-27T16:47:21.641071+0000 mon.a (mon.0) 1084 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-27T16:47:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:22 smithi094 bash[9811]: cluster 2021-01-27T16:47:21.655727+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-01-27T16:47:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:22 smithi094 bash[9811]: audit 2021-01-27T16:47:21.665082+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:23.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:22 smithi094 bash[9811]: audit 2021-01-27T16:47:21.953058+0000 mgr.y (mgr.14138) 631 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-27T16:47:23.669 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_snap_rollback ... ok 2021-01-27T16:47:23.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:23 smithi106 bash[9795]: audit 2021-01-27T16:47:22.658258+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:24.016 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:23 smithi106 bash[9795]: cluster 2021-01-27T16:47:22.658394+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T16:47:24.018 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:23 smithi106 bash[13484]: audit 2021-01-27T16:47:22.658258+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:24.018 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:23 smithi106 bash[13484]: cluster 2021-01-27T16:47:22.658394+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T16:47:24.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:23 smithi094 bash[9811]: audit 2021-01-27T16:47:22.658258+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? 172.21.15.106:0/871938315' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:24.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:23 smithi094 bash[9811]: cluster 2021-01-27T16:47:22.658394+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-01-27T16:47:24.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:24 smithi106 bash[9795]: cluster 2021-01-27T16:47:23.622491+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v689: 212 pgs: 4 creating+peering, 208 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:24.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:24 smithi106 bash[9795]: cluster 2021-01-27T16:47:23.664546+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T16:47:24.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:24 smithi106 bash[13484]: cluster 2021-01-27T16:47:23.622491+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v689: 212 pgs: 4 creating+peering, 208 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:24.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:24 smithi106 bash[13484]: cluster 2021-01-27T16:47:23.664546+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T16:47:25.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:24 smithi094 bash[9811]: cluster 2021-01-27T16:47:23.622491+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v689: 212 pgs: 4 creating+peering, 208 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-27T16:47:25.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:24 smithi094 bash[9811]: cluster 2021-01-27T16:47:23.664546+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-01-27T16:47:25.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:25 smithi106 bash[9795]: cluster 2021-01-27T16:47:24.679703+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T16:47:25.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:25 smithi106 bash[13484]: cluster 2021-01-27T16:47:24.679703+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T16:47:26.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:25 smithi094 bash[9811]: cluster 2021-01-27T16:47:24.679703+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e282: 8 total, 8 up, 8 in 2021-01-27T16:47:26.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: cluster 2021-01-27T16:47:25.623676+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v692: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:26.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: cluster 2021-01-27T16:47:25.682615+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T16:47:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: cluster 2021-01-27T16:47:25.688375+0000 mon.a (mon.0) 1092 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: cluster 2021-01-27T16:47:25.688431+0000 mon.a (mon.0) 1093 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: audit 2021-01-27T16:47:25.689837+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:26.955 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: audit 2021-01-27T16:47:25.780535+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:47:26.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: audit 2021-01-27T16:47:26.684221+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:26.956 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[9795]: cluster 2021-01-27T16:47:26.684837+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T16:47:26.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: cluster 2021-01-27T16:47:25.623676+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v692: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:26.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: cluster 2021-01-27T16:47:25.682615+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T16:47:26.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: cluster 2021-01-27T16:47:25.688375+0000 mon.a (mon.0) 1092 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:26.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: cluster 2021-01-27T16:47:25.688431+0000 mon.a (mon.0) 1093 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:26.957 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: audit 2021-01-27T16:47:25.689837+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:26.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: audit 2021-01-27T16:47:25.780535+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:47:26.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: audit 2021-01-27T16:47:26.684221+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:26.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:26 smithi106 bash[13484]: cluster 2021-01-27T16:47:26.684837+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T16:47:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: cluster 2021-01-27T16:47:25.623676+0000 mgr.y (mgr.14138) 633 : cluster [DBG] pgmap v692: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:27.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: cluster 2021-01-27T16:47:25.682615+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e283: 8 total, 8 up, 8 in 2021-01-27T16:47:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: cluster 2021-01-27T16:47:25.688375+0000 mon.a (mon.0) 1092 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-27T16:47:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: cluster 2021-01-27T16:47:25.688431+0000 mon.a (mon.0) 1093 : cluster [INF] Cluster is now healthy 2021-01-27T16:47:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: audit 2021-01-27T16:47:25.689837+0000 mon.a (mon.0) 1094 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:27.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: audit 2021-01-27T16:47:25.780535+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14138 172.21.15.106:0/619786337' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-27T16:47:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: audit 2021-01-27T16:47:26.684221+0000 mon.a (mon.0) 1096 : audit [INF] from='client.? 172.21.15.106:0/3408187737' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:27.038 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:26 smithi094 bash[9811]: cluster 2021-01-27T16:47:26.684837+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e284: 8 total, 8 up, 8 in 2021-01-27T16:47:27.695 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_snap_timestamp ... ok 2021-01-27T16:47:28.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:28 smithi106 bash[9795]: cluster 2021-01-27T16:47:27.624802+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v695: 212 pgs: 12 creating+peering, 9 unknown, 191 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:28.954 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:28 smithi106 bash[9795]: cluster 2021-01-27T16:47:27.687246+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T16:47:28.954 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:28 smithi106 bash[13484]: cluster 2021-01-27T16:47:27.624802+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v695: 212 pgs: 12 creating+peering, 9 unknown, 191 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:28.955 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:28 smithi106 bash[13484]: cluster 2021-01-27T16:47:27.687246+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T16:47:29.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:28 smithi094 bash[9811]: cluster 2021-01-27T16:47:27.624802+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v695: 212 pgs: 12 creating+peering, 9 unknown, 191 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-27T16:47:29.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:28 smithi094 bash[9811]: cluster 2021-01-27T16:47:27.687246+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e285: 8 total, 8 up, 8 in 2021-01-27T16:47:30.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:29 smithi094 bash[9811]: cluster 2021-01-27T16:47:28.704295+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T16:47:30.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:29 smithi106 bash[9795]: cluster 2021-01-27T16:47:28.704295+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T16:47:30.204 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:29 smithi106 bash[13484]: cluster 2021-01-27T16:47:28.704295+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e286: 8 total, 8 up, 8 in 2021-01-27T16:47:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:30 smithi094 bash[9811]: cluster 2021-01-27T16:47:29.625742+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v698: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 170 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:31.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:30 smithi094 bash[9811]: cluster 2021-01-27T16:47:29.718621+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T16:47:31.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:30 smithi094 bash[9811]: audit 2021-01-27T16:47:29.756309+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:31.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[9795]: cluster 2021-01-27T16:47:29.625742+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v698: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 170 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:31.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[9795]: cluster 2021-01-27T16:47:29.718621+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T16:47:31.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[9795]: audit 2021-01-27T16:47:29.756309+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:31.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[13484]: cluster 2021-01-27T16:47:29.625742+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v698: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 170 MiB used, 715 GiB / 715 GiB avail 2021-01-27T16:47:31.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[13484]: cluster 2021-01-27T16:47:29.718621+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e287: 8 total, 8 up, 8 in 2021-01-27T16:47:31.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:30 smithi106 bash[13484]: audit 2021-01-27T16:47:29.756309+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-27T16:47:31.728 INFO:tasks.workunit.client.0.smithi106.stderr:test_rados.TestIoctx.test_trunc ... ok 2021-01-27T16:47:32.036 INFO:journalctl@ceph.iscsi.iscsi.a.smithi094.stdout:Jan 27 16:47:31 smithi094 bash[22046]: debug mgr command failed -13 2021-01-27T16:47:32.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:31 smithi094 bash[9811]: audit 2021-01-27T16:47:30.721782+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:32.036 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:31 smithi094 bash[9811]: cluster 2021-01-27T16:47:30.722031+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T16:47:32.037 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:31 smithi094 bash[9811]: cluster 2021-01-27T16:47:31.722100+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T16:47:32.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[9795]: audit 2021-01-27T16:47:30.721782+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:32.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[9795]: cluster 2021-01-27T16:47:30.722031+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T16:47:32.204 INFO:journalctl@ceph.mon.a.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[9795]: cluster 2021-01-27T16:47:31.722100+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T16:47:32.204 INFO:journalctl@ceph.mgr.y.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[10032]: debug 2021-01-27T16:47:31.960+0000 7f0a47ffb700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-27T16:47:32.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[13484]: audit 2021-01-27T16:47:30.721782+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? 172.21.15.106:0/695644104' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-27T16:47:32.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[13484]: cluster 2021-01-27T16:47:30.722031+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e288: 8 total, 8 up, 8 in 2021-01-27T16:47:32.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Jan 27 16:47:31 smithi106 bash[13484]: cluster 2021-01-27T16:47:31.722100+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e289: 8 total, 8 up, 8 in 2021-01-27T16:47:33.021 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:32 smithi094 bash[9811]: cluster 2021-01-27T16:47:31.626777+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v701: 212 pgs: 6 creating+peering, 14 unknown, 192 active+clean; 25 KiB data, 170 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-27T16:47:33.021 INFO:journalctl@ceph.mon.b.smithi094.stdout:Jan 27 16:47:32 smithi094 bash[9811]: audit 2021-01-27T16:47:31.964282+0000 mgr.y (mgr.14138) 637 : audit [INF] from='client.34442 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:08:08.496 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-28T04:08:09.227 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2021-01-28T04:08:09.228 DEBUG:teuthology.task.console_log:Killing console logger for smithi094 2021-01-28T04:08:09.228 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2021-01-28T04:08:09.228 DEBUG:teuthology.task.console_log:Killing console logger for smithi094 2021-01-28T04:08:09.229 DEBUG:teuthology.exit:Finished running handlers